&

 

Independent Living Research Utilization 

navigation bar  ILRU Home Page Projects Publications Training Resources What's New
used as a spacer for looks

A Health Care Plan
Decision Support System
for People with Disabilities

[The following report was produced by Berkeley Planning Associates which is solely responsible for its contents.   It is used with permission.]

440 Grand Ave, Suite 500,  Oakland, CA 94610-5085


I. PROJECT BACKGROUND, GOALS AND OBJECTIVES

Background

This project is a practical response to the paucity of useful information that consumers, particularly those with disabilities, need to make a thoughtful choice among different health care plans. Our aim is to supply relevant information in such a way that actually changes the way people choose among different plans. In other words, the ultimate purpose of this project is to create well-informed consumers of health plans. By consumers, we mean end users of health care services rather than institutional purchasers and other intermediaries.

In the classical economic theory of "perfect competition", the independent well-informed consumer plays a central role in the competitive health care marketplace by judiciously choosing among similar products based on their price and quality. In the current healthcare marketplace, however, several factors directly undermine the role of well-informed consumer (Weisbrod, 1983). The project described below was conceived to respond to these factors and to take into account those market conditions described below that do not enhance consumer knowledge.

First, health care plans do not offer standardized benefits. Without a homogenous product, effective price competition is difficult to achieve, and consumers must compare apples with oranges rather apples with apples and oranges with oranges. Needless to say, health care plans are far more complex than fruit. Sweetness, flavor, and texture are nothing compared to deductibles, copayments, annual and lifetime maximums, physician reputation, convenience, and courtesy. Indeed, to switch metaphors, health care plans often are characterized as moving targets, impossible to pin down as to coverage and price. This presents a serious obstacle to providing reliable and valid information to consumers.

Second, insufficient information exists that indicates what would happen if health care coverage is not purchased compared with what would happen if it was obtained. AHCPR currently supports Patient Outcome Research Team (PORT) research to assess the efficacy of specific medical treatment procedures and shared decision-making programs (Casper et. al., 1992) have been developed to involve the patient in making treatment decisions. Report cards based on mortality data and consumer satisfaction comparison ratings have attempted to fill this gap. Unfortunately, the reliability and validity of these data are frequently challenged (GAO, 1994) although some efforts have begun to standardized consumer satisfaction ratings (RTI, 1995) and set national accreditation standards (NCQA, 1994). Other information such malpractice data exists but is not available (with some good reasons) to the general public.

Third, decision-making is often relinquished to agents who are sellers and providers of health care coverage or, like company benefit managers, represent interests other than the end user of the health care plan. As we describe in our guidebook marketing representative can often mislead individuals about coverage availability; brokers may represent a limited number of plans from which they receive commissions; and company benefit managers must pay heed to the financial needs of the firm as well as the interests of the employee.

In addition to these direct factors, several conditions in the health care marketplace indirectly, but substantially, exacerbate the problems consumers face in making thoughtful choices about health care plans (DeJong and Sutton, 1994). In the health care industry, providers and payers rather than consumers set prices. A second condition is the prevalence of experience rating which forces health plans to compete on the basis of risk and price rather than quality. These health care plans design their coverage package and price to appeal to low users of health care services and discourage enrollment by high user of services such as individuals with disabilities. A third, related, condition is absence of risk or case-mix adjustment to reflect the different utilization rates of consumers. Without risk adjustment, plans have little incentive to enroll or subscribe high user groups such as people with disabilities. A fourth problem is the under-representation of consumers in the governance of the health care system. The boards of private health care plans are dominated by physicians and business people. Even accrediting agencies like the National Committee on Quality Assurance substantially involve consumers in setting standards and evaluating health plans.

This analysis helped us the shape the goals and objectives of this project. It also led us to formulate two key principles that would guide us in designing the decision support system. Foremost, we sought to create information that is based on the actual experiences of people with disabilities. We believed that people want to hear how other similarly situated individuals evaluate their health care options and go about choosing a health care plan. While this seemed key, we also believed that people would prefer additional input and lots of it. It would be our job to transform these data into useable information by reducing distilling it and packaging it in engaging ways.

Project Goals and Objectives

The goal of this SBIR project is to develop a Decision Support System to help people with disabilities, particularly those with physical disabilities, choose health care plans that best meet their needs. Given the scarcity of resources, especially during Phase I, we decided to focus on individuals between the ages of 18 and 65 with severe mobility impairments. Examples of specific conditions include:

  • amputations
  • post polio
  • cerebral palsy
  • spina bifida
  • cystic fibrosis
  • spinal cord injuries
  • multiple sclerosis
  • head injuries
  • muscular dystrophy
  • stroke

Persons with these conditions tend to have a common constellation of health problems such as decubitus ulcers, urinary tract infections, respiratory tract infections, and osteoporosis.

The Decision Support System, tentatively entitled Choosing A Health Care Plan for Independent Living, will include both "low tech" products such as brochures, guidebooks, and workbooks, as well as a "high-tech" products such as a videos and an interactive CD-ROM program. In their final form, these products will be available in a variety of accessible formats including braille, audiotape, closed-captioning, and voice activated computer diskettes. While each informational format will be designed to stand alone, they will be linked by common content. For example, both the draft guidebook and the prototype CD-ROM program developed in Phase I contain anecdotes of how health plan information can mislead consumers in to believing that services they thought would be available actually are not. In the guidebook this information is conveyed in text; whereas in the CD-ROM program it is convey in a voice narrative presented as a radio call in show. The brochure we will develop during Phase II will distill some of the information presented in the guidebook.

During Phase I, we focused our efforts on producing two major products: (1) a detailed guidebook including worksheets for assessing the cost and adequacy of different health plan and a glossary of terms, and (2) a CD-ROM program presenting a wide array of information ranging from a physician's perspective on the health care needs of individuals with physical disabilities to the personal experiences similarly situated people have had in choosing a health care plan.

To accomplish the goals of this project, we sought to complete three major objectives.

(1) Determine the information needs of people with physical disabilities. This objective addresses how people with disabilities assess the key features (price, benefits, restrictions, etc) of a health care plan, relate these elements to their own health care needs, and assess quality of care.

(a) What are the salient factors people with disabilities consider in choosing a health care plan?

(b) What are the trade-offs people with disabilities consider in choosing a health care plan?

(c) What sources of information do people with disabilities use in choosing a health care plan?

To achieve this objective, we relied mainly on focus group interviews with persons with disabilities. These focus groups were conducted in the Oakland, California, and Houston, Texas to vary consumers input from those from a highly competitive and richly developed and predominantly managed care marketplace to a less developed fee-for-service environment. We also conducted key informant interviews with health care and disability experts including experts with disabilities across the country.

(2) Validate the content of the decision support system. This objective is aimed at developing a decision support system that has a high likelihood of improving consumer awareness and fostering independent decision-making among people with physical disabilities. Specific questions include:

(a) What factors should we consider in optimizing the reliability, comprehensiveness, accuracy, objectivity, and usefulness of the decision support system?
(b) What outcomes should we expect to observe from consumers exposed to the guidebook and CD-DOM program?

To answer these questions, the project team conducted open-ended key informant interviews with researchers, policy experts, and disability advocates/consumers.

(3) Develop a prototype of the decision support system. Early in the project, we realized that we did not have sufficient resources to develop a variety of low- and high-tech products. Accordingly, we focused our efforts on developing a substantial "low-tech" guidebook and a comprehensive CD-ROM product. One measure of the success of this project is how success the project team has been in producing prototype versions of the guidebook and CD-ROM program. Specific research questions include:

(a) Can we demonstrate the feasibility of developing a decision support system consisting of "low tech" and "high tech" products?

(b) What are the substantive and technical strengths and weaknesses of the decision support system, particularly the "high tech" prototype?

For several reasons, we decided to allocate scarce project resources to obtaining an independent review of the technical and substantive aspects of the CD-ROM version of Choosing A Health Care Plan For Independent Living. Because the content of the CD-ROM duplicates some parts of the guidebook, independent review of both products would be redundant. Furthermore, we anticipate that all Agency reviewers would have the expertise to evaluate the guidebook, but few would have the expertise to assess the technical merits of the CD-ROM program. Finally, even though the technology will soon become widely available, we perceived that not all Agency reviewers could readily view the CD-ROM program. Thus we hired independent consultants to provide a detailed review.

In the next section we describe the methods used to achieve these objectives.

For people with disabilities, choosing a health care plan poses problems due to:

(1) insufficient disability-relevant information about various health plans;

(2) lack of clarity about the specific types of services provided by different plans and the direct and indirect costs to the consumer;

(3) physical, sensory, or cognitive impairments that limit access to or understanding of the information provided; and

(4) inability to project the long-term consequences of various choices in terms of maintaining health and functional capabilities an in terms of cost to the consumer making the choice.


II. PROJECT METHODS

OVERVIEW

In this chapter, we describe the variety of methods used to pursue project objectives. We conducted focus groups and key informant interviews to understand how people with disabilities think about health care choices. In addition, we conducted key informant interviews with a national sample of researchers, policy experts, product developers, and advocates in the fields of health care and disability. Based on input from these sources, we drafted sections for a written guide to choosing a health care plan and drafted scripts and other materials for use in the CD-ROM. Starting with these draft materials we engaged in an iterative process combining the content and technical aspects of each products. The most challenging aspect of this process was blending of content and format of the CD-ROM. At the end of the project, we also sought an independent review of the CD-ROM from disability and computer technology experts.

To ensure against geographic and market provincialism, focus groups were conducted in Oakland, California and Houston, Texas. Differences between the population of the two states are shown in Table 1. State and national population data shows that a lower percentage of Texans have completed high school than have Californians and all U.S. residents. However, the percentage of Texans who have completed college is equal to that of the entire U.S. population. The rate of severe work disability and mobility difficulties are about the same for both states, while the rate of self-care difficulties is higher in California. On the other hand, the rate of need for assistance in Instrumental Activities of Daily Living (IADL) or ADL is higher in Texas.

Table 1

Differences in the health care markets in Texas and California are shown in Table 2. This table indicates clearly that Health Maintenance Organizations (HMOs) are far more prevalent in California than in Texas, but that Preferred Provider Organizations (PPOs) are more prevalent in Texas. These data suggest that Californians are more likely to be oriented toward HMOs than are Texans. Conversely, Texans are less likely to experience health care through a HMO and more likely, we believe, belong to a PPO or fee-for service plan.

Table 2

Aware that this orientation might bias the results of the focus groups, we were careful to take it into account during the analysis of focus group data. We were also concerned that the guidebook, which was developed by the Houston-based study team would be oriented toward fee-for-service and PPO plans, and that the CD-ROM developed in California would reflect HMO experiences. To avoid these biases, the two principal investigators exchanged draft versions of the guidebook and CD-ROM scripts, talked frequently via the telephone, and had two extended face-to-face work session in Houston. Later, we report on how successful we were in integrating these perspectives.

FOCUS GROUP DISCUSSIONS

In order to learn more about how people with physical disabilities choose among different health care plans, BPA and ILRU conducted focus group discussions in Oakland and Houston, respectively. These group discussions addressed four broad topics related to choosing a health care plan, namely:

1) What are the salient factors that people with physical disabilities consider in choosing a health care plan?

2) What issues arise among people with physical disabilities in obtaining quality health care as defined above?

3) What sources of information do people with physical disabilities rely on in selecting a plan? and

4) What formats (brochures, videos, computer software, etc.) are preferred?

Two focus groups were conducted at each site; one group was composed solely of women while the other group was composed of men and women. All individuals had physical disabilities (e.g. paraplegia, multiple sclerosis, etc.) and/or chronic illnesses (e.g., diabetes, enlarged heart, etc.). The Houston groups, however, had more participants with severe mobility impairments. All participants resided in the East Bay area of Northern California (Berkeley, Oakland, Hayward, etc.) or the metropolitan Houston area.

Each group discussion was recruited using an identical protocol (see Appendix A: Focus Group Telephone Screening Instrument, Participant Recruitment, and Moderator's Guide). Recruitment activities included posting of notices in Independent Living Centers and other organizations for people with disabilities such as Easter Seals. We also used word-of-mouth and advertised at wheelchair manufacturing and repair shops.

In Oakland, meetings were held on at BPA's meeting room facilities. ILRU sponsored groups were held at a centrally located hotel in Houston. Each group was moderated by an individual with a physical disability. Training of the moderators and assistant moderators was provided by the Principal Investigator, and detailed protocols were used to insure uniformity (See Appendix XX).

At 5:45 PM, prior to each group meeting, participants were asked to complete a short questionnaire assessing their demographics characteristics and how they rated the quality of health care they have received under their current health care plan. The seventeen items were derived from several sources including health plan satisfaction surveys and a survey of disabled employees conducted by ILRU. A light dinner buffet was provided to all participants and the formal discussion began at 6:10 PM. Participants were given $25 each and reimbursed for extraordinary transportation needs. Each group was audio-taped. Immediately following each focus group, the principal investigator or co-principal investigator debriefed the moderator and assistant moderator. A summary of each group was prepared based on notes from the debriefings, flip chart notes from each session, and the audio-tapes.

Our original plan was to conduct two rounds of focus groups in each site, partly to guard against "bad" groups and partly to explore new questions that might arise in the first round of discussions. However, we found this unnecessary. Each group was conducted without major problems, results from each group tended to be confirmed by the results from the other groups, and many of these results resonated with results obtained from other focus groups of consumers conducted by the National Committee on Quality Assurance and the Research Triangle Institutes consumer satisfaction survey design project (see Chapter IV).

KEY INFORMANT INTERVIEWS

We contacted experts in the fields of disability, health care, and disability advocacy in order to explore several key technical issues and to confirm the insights provided by focus group participants. We provided each expert with a synopsis of the project and description of the goals and components of the CD-ROM version of the Decision Support System. Specific discussion topics included:

(1) Salient factors someone with a physical disability should consider in choosing a health care plan?

(2) What kinds of information someone with a disability would consider most useful in choosing among competing plans?

(3) Suggestions about any existing material we should review?

(4) Suggestions for making the product stimulating, objective, and useful?

(5) Should we take strong positions on what health care plans are good and bad for people with disabilities?

(6) How can this product be designed to help consumers protect themselves against misinformation provided by health plans and other behaviors that are not in the best interests of people with disabilities?

We compiled a list of approximately 40 individuals gleaned from the academic and trade literature on health care and disability and 30 leaders in the disability arena. In exchange for their mailed-back comments, we promised to send them a summary of this report, and to acknowledge their input without implying endorsement of any product. We also promised to contact by phone those persons who did not return a written response. When circumstance allowed, the Principal Investigator conducted in-person interviews with a small number of these experts. Of the 70 individuals contacted, 45 provided some kind of response.

PRODUCT DEVELOPMENT

The development of the draft guidebook and prototype CD-ROM program ia best described as an iterative process in which substantive issues are considered in terms of the ability of the media (print or CD-ROM) to communicate the essential meaning of the issues derived from the focus groups and key informant interviews. While these source provided essential ideas for form and content of the CD-ROM, several questions remained:

(1) What should be the specific style of each product?

(2) What title best captures these aims?

(3) How should the content be arranged? and (4) What icons, graphics, and other presentation techniques are most appealing?

To answer these questions, we brainstormed among ourselves and, when necessary conducted informal interviews with technical experts and a small number of focus group members and other experts in the disability field.

We based the guidebook on a basic outline of important features of a health care plan and the important issues people with disabilities must encounter in choosing a plan. We developed definitions of important health care terms and concepts that should help to resolve plan coverage, price, and quality questions in terms of consumer needs. We also designed worksheets to resolve difference between service needs and plan coverage, quality needs and quality delivered, and costs and resources. After several drafts, these issues were translated into a draft document answering a series of questions that a typical but highly skeptical consumer might ask about health care plan.

The CD-ROM program also began with drafting preliminary descriptions of the basic theme and each component of the program. Initial ideas were inspired by comments made by focus group members and from feedback form our sample of experts. For example, both experts and consumers recommended that it would we very useful to have a physician's views of the health care issues people with physical disabilities are likely to encounter over the life course. A series of medical questions was then generated and a plan was prepared to video-tape a physician. These descriptions were circulated among key members of the project team for comments.

Perhaps the most challenging aspect of this process was the technical feasibility of specific ideas for each component of the CD-ROM. For example, we had planned to prepare several videos of persons with disabilities discussing their reasons for choosing their particular plan. We also wanted to include other video segments in the program. However, the current CD-ROM technology severely limits the number of video minutes in a given CD. Thus we were forced to reduce the number of video segments and limit their length. As we encountered these limitations, we gradually began to get a clear idea of what we could accomplish in a prototype CD-ROM program given the current level of resources.

INDEPENDENT REVIEW

Given the advance nature of CD-ROM technology, it was imperative to obtain an independent assessment of our prototype. Accordingly, we asked three experts to review the CD-ROM program and submit criticisms and comments to AHCPR based on their expertise. Each experts was asked to assess the CD-ROM program along the following terms:

1. Comprehensiveness. Please assess the comprehensiveness of the product in addressing the information needs that people with disabilities have or should have in choosing a health care plan. Are there other areas that should be addressed? What areas need more emphasis?

2. Accuracy and Consistency. How accurate is the information presented in the program? Are there glaring errors or misstatements? Is the information internally consistent?

3. Objectivity. To what extent is the information presented in the program objective and unbiased? How do you think HMOs, PPOs and other plans will react? How do you think the disability community will react? Will a typical user discern a bias that will discourage her or him from using the product?

4. Accessibility. Please assess the tone, content, formats, and other aspects of the program with respect to its "user-friendliness."

5. Entertainment Value. Do you think that this program is stimulating? How would you make it more interesting and fun to use?

6. Impact. Does this product have the potential to affect the decisions people make about health care? How should that impact be measured?

7. Weaknesses. From your perspective, what are the overall weaknesses in this CD-ROM project?

8. Strengths. Overall, what are the strengths of this CD-ROM product?

          9. What other comments and criticism do you have?

By the end of the project, two of the three experts had responded. Comments from the third reviewer will be included with the Phase II proposal.

In the following Chapter we present the results of our project efforts.


III. RESULTS

OVERVIEW

In this chapter, we present the results of the research activities (focus group discussions and key informant interviews) and briefly describe the prototype guidebook and CD-ROM developed during Phase I. We also provide the comments and criticisms of the CD-ROM submitted by our independent reviewers. A draft copy of the guidebook may be found in the Appendix. A single copy of the CD-ROM version (disk and accompanying documentation) has been submitted to the AHCPR project officer. A detailed description of each component of the CD-ROM may be found in the Appendix.

FOCUS GROUPS

Composition.

Table 3 displays the demographic and health characteristics of the focus group participants as well as how they rate the quality of care received from their current plan. Although the participants from the two sites were similar with respect to age, gender, and marital status, the Houston participants were more educated and self-reportedly healthier.

An important difference, as we expected, was that no one in the Houston group belonged to a HMO, while no one in the Oakland groups subscribed to a fee-for-service plan. Participants in the Houston women's group reported much higher satisfaction with their health care plan and rated the quality care received higher than any of the other group participants.

Table 3

Factors and Trade-Offs in Choosing a Health Care Plan?

Participants identified six types of factors they considered important in choosing a health care plan:

Costs factors included premiums and deductibles, hidden and out-of-pocket costs.

Accessibility included accessibility of physician' office, the availability of a low examining table, out-of-area coverage, no pre-existing condition restrictions, and the availability of the primary care physician.

Adequacy factors included the availability of competent resources and equipment; coverage for durable medical equipment (especially wheelchairs, protheses, and orthotics) alternative care (e.g., acupuncture, chiropractic), and emergency coverage for durable medical equipment; and variety of other services such as preventive care, psychiatric care, and attendant care. Those individuals whose disability occurred as a result of a work injury, or who incurred another injury while on the job, were highly critical of the inadequate way health plans handle workers' compensation claims. Attendant care, considered by many disability experts to be the cornerstone of maintaining one's functional capacity, was not afforded a high rank by many participants. While they frequently or continuously required personal assistance, many participants simply assumed that health care plan are not responsible for this kind of care.

Quality of Care factors covered many of the same factors identified in the literature including continuity of care, timeliness, respect and courtesy, accuracy of information, etc. What may distinguish these participants for other non-disabled consumers is the urgency of factors like quickness of assessment, waiting, delays in obtaining durable medical equipment, the physician's expertise in the specific disability, and the doctor's ability to listen to the consumer (if the doctor is not familiar with the disability). More than a few participants articulated that it was just as important that the primary care physician understood health problems like respiratory illnesses that it was for she/he to be an expert in a particular condition such as muscular dystrophy.

Other Factors mentioned by our participants included reputation/prestige, open-mindedness and flexibility of professional staff, problems with getting approval/referral especially for basic needs such as durable medical equipment. Many people agreed with the sentiment the best health care plan is "a plan where you don't have to fight." As other research indicates, participant attitudes toward there own health care took on an air of negativity as the discussion focused on specific instances of care. One horror story begat another. In two groups, participants seemed divided between those who viewed these negative anecdotes as exceptions, and those who believed they are representative of the plan. One woman characterized her plan as "horrible" with respect to the treatment she received for her brain injury, and wonderful when it can to diagnosing and treating her breast cancer. For a problem that any women might have, treatment was very competent and gracious; for a disability, especially one often perceived as resulting from irresponsible behavior, treatment was disorganized and decidedly ungracious.

In identifying what they consider to be important components of quality of health care, each group of participants made the distinction between what they considered to be ideal health care delivery and what they considered to desirable health care in the real world. When asked to explain the difference, many participants told us that they were so used to inadequate care that they just did not think it was possible to have access to high quality and adequate care.

As the discussion of salient factors in choosing a health care plan evolved, a spectrum of health care plan savvy emerged among participants in each group. Many people, especially women, were sophisticated consumers of health care. For them, issues such as whether the health plan abortions, permitted referrals for acupuncture and other alternative services, and provide specialized information menopause and estrogen treatment played an important part in how they assessed the care they received. These people offered articulate advice about choosing a health care plan: "ask a very detailed question about an obscure service need such as acupuncture and see how they handle it," and how to maximize services: "make two back-to-back appointments with the same physician. This way you'll have enough time to get onto the examining table and be able to ask the doctor questions afterward."

People in this category were very adept ate getting what they wanted from their health care providers using a combination of screening skills for provider selection and knowledge of system operations to exert pressure on providers and payers in order to obtain services and products needed to maintain their health. Notwithstanding this apparent adroitness in obtaining needed services from a system that generally provide for few options, there were significant problems cited by group members. One participant receiving COBRA coverage from her most recent employer reported that because she could not obtain health care coverage from any other provider in the Houston area, she was forced to relocate to another area of the state.

Others belonged to a less sophisticated group of consumers with respect to exposure to choice of health care plans. As one participant put it, "I really have a lot of work to do. I really don't know anything about how to choose a health care plan." The lack of savvy was more prevalent in the Houston groups where choices are more limited and a greater percentage of participants had spent more years enrolled in Medicare and/or Medicaid. We concluded that our efforts to deign products to assist individuals in selecting health care plans need to be relevant to people who have not been faced with choices before and may have relatively little understanding of the influence of various factors on the quality, adequacy, and accessibility of health care services.

Despite the differing levels of knowledge and sophistication, each group agreed that costs was the most important factor influencing their choice of health care. For those in traditional fee-for-service plans, costs were followed by inclusion or exclusion of pre-existing conditions, provider experience with disability, coverage of personal assistance services, and range of covered services. Participants who are enrolled in HMOs were not concerned about pre-existing coverage and tended to rank range of covered services above all factors except costs.

These findings are similar to findings obtained in focus groups with consumers conducted by the National Committee on Quality Assurance (Shelton, personal interview, 1995).

Sources of Information

Without question the consensus among all groups was that the best information on health care plans could be obtained from persons with disabilities similar to one's own who had experience with the plans under consideration. Any information generated by groups or methods that did not include significant involvement of people with disabilities was suspect, including information from company benefit managers, well-meaning relatives, friends and co-worker with disabilities. Furthermore, participants preferred information based on the actual experiences of other similarly situated persons over didactic information even though it may be provided by disability-specific consumer organizations like Independent Living Centers and the Muscular Dystrophy Association. At the same time, however, other sources of information were perceived as useful including marketing brochures, newspaper articles, health plan staff, and health fairs. In conjunction with information and advice from peers, these additional sources were not only views as useful but also as necessary. We interpreted these comments as a demand for reliable and valid data.

Problems with Plan-Provided Information

Focus group members clearly had difficulty with the information that was provide to them by the health care plan itself. Several individuals complained often of lack of forthrightness and sometimes quite bitterly of misinformation. Participants identified several aspects of a health plan for which they wanted detailed information, namely how the plan deals with workers' compensation claims, track record of how they have treated people in the past, what plan facilities provide what services, availability of medication without additives, access to medial records, right to sue, and evidence of gross negligence? Once again, these comments reflected concern for reliable, comprehensive, and accurate information.

Return to Top of Page

KEY INFORMANT INTERVIEWS

One purpose of the key informant interviews was to confirm information provided by focus group participants. Although there was general agreement with respect to salient factors people with disabilities should consider in choosing a health care plan, our experts raised additional concerns and framed old issues in different language. Expert respondents emphasized access to specialty care along with the range or completeness of benefits. Some respondents added that the ability to assign a specialist (e.g. pulmonologist) as a primary care physician more important than allowing easy access to specialists. Reasoning like this led many respondents to identify choice of physician as a critical factor in choosing a plan. Some experts were able to cite specific data such as "women with disabilities see specialists more often than able-bodied women and they use emergency rooms more often, probably due to barriers to primary care."

It was in the area of information requirements that our key informants provided the most valuable advice. Like the focus group members, key informants identified the need for same types of plan information (premiums, coverage, restrictions, etc.) and the need for subjective ratings based on the experience of people with disabilities, they also emphasized the need for external objective ratings (e.g. NCQA type accreditation) that also takes into account the uniques needs of high users of health care services. And like our focus group participants, the experts expressed a strong concern for reliability and validity, albeit from a professional, research-oriented perspective.

What our key informants made very clear, however, was just how difficult it is to achieve even minimum levels of reliability and validity. Many respondents emphasized the importance of standardizing plan comparisons and avoid methodological biases by administering the same assessment tools in the same way. Likewise, in the analysis, use same decision rules and control for (in the case of ratings and report cards) for differences in health status. Other took a more philosophical approach, commenting that "health care is a morel enterprise so 'objectivity' may be impossible, and "just present the facts as best they can be determined. There are a lot of gray areas.

The key informants were strongly opinionated about whether the decision support system should take strong positions on what health care plans are good or bad for people with disabilities. Answers ranged from "Yes, to a great extent," to "be careful, unless you feel absolutely solid about comparability of data," to "I don't think it is at all appropriate. These is no 'best' plan for all individuals with disabilities." While the range of responses was wide, the most common response was simply to provide as much relevant information as possible for the user to make up his or her mind. When warranted, specific problems can be raised about specific plans as long as there are data to support the claim. This appeared to bring us full circle to the reliability and validity problems discussed earlier.

Finally, we inquired about what outcomes we should expect from someone who uses the decision support system. Some expected total skepticism that such an intervention would really motivate people to change. Others thought that the information would motivate people to change plans and that one could observe measurable indications such as reduced out-of-pocket expenditures and increased satisfaction with health care received. Still others suggested self-reported satisfaction with the information system and testing individuals along the line of a health insurance IQ test.

PRODUCT DEVELOPMENT

As stated earlier, our goal was to develop examples of a set or range of informational materials under the rubric of Choosing a Health Care Plan for Independent Living that in conjunction with other "low tech" and "high tech" products are intended to reach a wide range of people with disabilities. The print-oriented guidebook and multimedia CD-ROM are not finished products. Rather, they are stylized examples of more fully developed and beta-tested products we will complete during Phase II.

Much work remains to be completed. In this section we describe the two prototypes developed during Phase I.

Guidebook Version

A complete draft version of the guidebook version of Choosing a Health Care Plan for Independent Living is provided in Appendix F.

Figure 4-2 displays the cover page of the guidebook. It represents the reality that many people with disabilities face choices in health care. Overtime, we believe that more and more persons with disabilities, even those with the most severe disabilities who qualify for Social Security Insurance (SSI) and Social Security Disability Insurance (SSDI) may be empowered to choose among different health care plans.

Figure 4-3 displays the table of contents of the guidebook version of Choosing a Health Care Plan for Independent Living. The guidebook consists of four sections. Section One is a question and answer discussion of health care plans based on major topics raised during the focus groups and by key informants. We strive to provide examples and facts while offering advice and examples questions that consumers should heed or ask of market representatives and other purveyors of plans. The question and answer technique is intended to goad readers to be inquiring and skeptical. Section Two provides worksheets for consumers to assess their health care plans. This section helps the consumer to specify features of a health care plan. Section Three is a glossary of important term in the health care field. Section Four provides contact information on state insurance departments. These agencies are usually the first regulatory agency to direct complaints.

CD-ROM Version.

The prototype CD-ROM version of Choosing a Health Care Plan for Independent Living was designed to provide interactive access to a wide range of information on choosing a health care plan. The CD-ROM program is designed to work on both Apple and PC platforms. Figure 4-4 displays the opening screen of the program - a picture of an idealized study carrel such that one might find in the most modern of libraries. The carrel contains a TV screen, a boombox radio, a set of books, a clipboard upon which are several topics, and a light switch that allows the user to exit the program. After the program credits and disclaimer role through the TV screen, a narrator welcomes the user and tells she/he that moving the arrow over any item on the screen will cause a brief explanation of the contents of that item to appear on the TV screen. By double clicking on the item, the user can enter a specific subprogram. A narrator then explains how to use each subprogram. To exit any given subprogram, the user may double click on the EXIT sign.

In the prototype, we opted for a study carrel scenario. We also considered two alternative metaphors/scenarios, namely (1) a modern marketplace or an aisle in a supermarket, and (2) A booth at a health fair. During Phase II we will have the opportunity to develop these scenarios and submit them to focus group for guidance.

Below is a brief description of the contents of each item in the study carrel.

Credits/Disclaimer: authors, acknowledgements, credits, and as a warning that people should consult a medical professional about medical problems.

Books: Glossary: same as glossary in print version
Legal Guide: Questions and Answers regarding one's rights to health care benefits and employment under the Americans with Disabilities Act of 1990.
Resource Guide: Books and other material related to health care and disability
Bibliography: A list of academic and popular literature on health care, consumer choice, and disability

Radio: Health Plan Talk Radio Questions and Answers: a talk format designed to raise common questions about health plans based on real questions, complaints and advice consumers might have about choosing a health care plan and making the best of the situation once one has enrolled.

Clipboard: Introduction: A five minute video of Lex Frieden, Vice President of The Institute for Rehabilitation and Research and former chair of the President's Council on Employment and Disability. Lex argues why it is important for people with disabilities to become well-informed consumers of health care plans.

Ask the Doctor. A ten minute video of Dr. Jonathan Strayer of the Baylor College of Medicine in Houston, Texas. Dr. Strayer answers questions about the health care needs of people with physical disabilities over the life course. The user may select from a menu of questions addressing the health care needs of specific age groups and those of men and women.

Self Assessment of Coverage: This series of questions asks the user to indicate what health care services they needed during the last twelve months and whether the user's health care plan covered (full, partial, or not at all) that service. A "coverage quotient" bar at the bottom of the screen keeps a running total of the percentage of health care needs covered.

Self Assessment of Quality: A series of questions mostly drawn from AHCPR-developed national survey of consumer satisfaction asking the user to rate his/her current plan on 19 dimensions of quality of care (Poor to Excellent). Upon completing the questionnaire, the user may then view a bar chart of his/her ratings ("My Plan"). The user may also see how other people with disabilities rate their plan. In the prototype we show two other ratings (Rob/Prucare and Maureen/Kaiser North). In the fully developed product we will add many more personal ratings as well display averages.

Comparing Personal Experiences: Two videos of individuals (Rob and Maureen) with disabilities answering specific questions about their reasons for choosing their current plan. The user may view the entire video of each individual or may opt to hear the answer to specific questions. In the more fully developed product, we will provide more of these personal experience videos including videos of people who have disenrolled due to cause.

Comparing Health Plan Ratings: This component uses charts to compare the benefit structure of a typical HMO, PPO and FFS plan. It also reports the accreditation rating of various plans in the region (limited currently to HMOs reviewed by the Nation Committee on Quality Assurance). We also provide a chart comparing the consumer satisfactions rating developed by the Bay Area Business Group on Health for the specific plans in the prototype. Definitions of the terms used in the charts are provide as are explanation of how NCQA accredits plans and how BBGH measures consumer satisfaction.

Menu Bar. At the top of the study carrel is a "Menu Bar" from which different menu may be "pulled down" by double clicking on the item.

Options: This feature allows the user to select a closed-captioned, Spanish translation, or voice activated version of the CD-ROM program. The current prototype does not yet have these features. These and other techniques to make the CD-ROM more accessible will be added to future versions of the program.

Plan Info: Brief descriptions of specific health plans. Current list includes Aetna (PPO), Health Net (HMO), Kaiser North (HMO), PruCare of California (HMO), TakeCare (HMO), John Alden Life (FFS), and Employers Health Insurance (FFS). These blurbs are based on marketing material provided by the plans. They are not intended to be comprehensive or necessarily accurate. We are just passing on how each plan describes itself.

Documentation. A complete set of written documentation is provided with the CD-ROM including:

(1) Know Bugs and Limitations
(2) Getting Started
(3) Technical Notes


IV. CONCLUSIONS

OVERVIEW

In this chapter, we summarize the major research findings and product development results of this project. We also discuss the implications of the findings for consumer choice research and the feasibility of conducting further product development under Phase II of the SBIR program.

SUMMARY AND IMPLICATIONS OF MAJOR RESEARCH FINDINGS

Based on focus group interviews conducted in Oakland and Houston, people with physical disabilities share common priorities and methods of choosing among different health care plans. First, they share a common hierarchy of concerns at the top of which is the costs (premiums, copayments, deductibles, and hidden out-of-pocket expenses). For those with experience mainly in fee-for-service plans, the cost factor is closely followed concerns about pre-existing condition restrictions, then the range of covered services with emphasis on durable medical equipment and personal assistance. Quality of care, while necessary, ranked last in this hierarchy. Participants who are enrolled in HMOs were not concerned about pre-existing condition exclusions, but otherwise shared the same hierarchy of values in choosing a health care plan.

While there seem nothing surprising about these findings, what stood out was the urgency expressed in the need for durable medical equipment and personal assistance. Without them, participants reported that their health status and functional capacity would worsen, and they would find it difficult to fulfill their social roles as husband, wife, lover, friend, and worker.

Despite these expressions of concern, it is remarkable that many participants looked fatefully at choosing a health care plan. Many expressed the belief that choice was genuine. And most distinguished between what is ideal (e.g., personal assistance as a health care cost), desirable (full vs. partial coverage for durable medical equipment), and real (only partial reimbursement for durable medical equipment and no custodial personal assistance). Many people, matter-of-factly, simply did expect any health care plan to provide what they really need.

Another major finding is the clear expression of the need for reliable and valid information upon which to base their decision to subscribe or enroll in a given health care plan. For focus group participants, reliable and valid information meant information based on the experiences of people like themselves. At the same time, other sources of information, including professional assessments of quality of care, were welcomed and often highly valued, as long as this information is consumed in conjunction with the real life experiences of one's peers.

Expert feedback also emphasized the need for reliable and valid information, and just how difficult it is to achieve. Our experts seemed to be telling us that many informational products and services including popular guidebooks, consumer ratings, and other services have poor reliability and questionable credibility. We should be care to develop valid and reliable measures of quality of care, administer them with the same rigor that a well-designed consumer survey is administered, use consistent decision rules in the analysis of the data, and control for different levels of health care utilization and other factors.

SUMMARY AND IMPLICATIONS OF PRODUCT DEVELOPMENT RESULTS

During Phase I, the project team designed and develop one "low tech" and one "high tech" component of a decision support system to help people with physical disabilities choose health care plans. The "low tech" product is a complete guidebook consisting of questions and answers about choosing health care plans, worksheets, a glossary of important terms, and a resource guide. The 'high tech" product is an interactive CD-ROM program consisting of text, narration, videos, a radio program, and self-assessment exercises.

Although the guidebook and CD-ROM are not flawless, we feel that they are substantially valuable and practical contributions to the goal of enhancing consumer among people with disabilities. We have demonstrated that useful "low-tech" and "high tech" products can be developed with limited resources that not only respond to the information needs of people with disabilities as articulated by our focus group participants, but also can be prepared in engaging and interactive formats. For these reasons, we have met or exceeded every objective and goal of this Phase I project.

Authors:
Stuart P. Hanson, Berkeley Planning Associates
Quentin W. Smith, The Institute for Rehabilitation and Research
David J. Simon, Menlo Park

Project Team
Stuart P. Hanson, Principal Investigator
Quentin W. Smith, Co-Principal Investigator
David J. Simon, Multimedia Consultant

Berkeley Planning Associates
Ann Cupolo
Sasha Gottfried
Susan Haight
Dennis Meehan
Pat Spikes-Calvin

The Institute for Rehabilitation and Research
Lex Frieden
Joyce Frieden
Kim King
Laurie Redd
Jonathan Strayer, MD.

Consultants
Lawrence H Boyd, Ph.D.
Gerben DeJong, Ph.D.
Jan Hecht, Ph.D.
Maureen Donahoe
Robert Mudd

Many people contributed to this project. Foremost were those people who attended our focus groups in Oakland and California. Belying the belief that the "only thing focus group participants share is a desperate need for $25," our participants freely shared their experiences and worked hard to analyze their underlying preferences for health care. We would also like to thank Nancy Ferreyra in Oakland and Joyce Frieden in Houston for their help in recruiting focus group participants. Last but not least, we would like to thank Maureen Donahoe and Robert Mudd for volunteering to share their thoughts about choosing a health care plan.

This project has been funded, at least in part, with federal funds from the Agency for Health Care Policy and Research, Public Health Service, Department of Health and Human Services under Contract No. 282-94-2032. The contents of this publication do not necessarily reflect the views of the Department of Health and Human Services, nor does mention of trade names, commercial products, organizations imply endorsement by the U.S. government.

A HEALTH CARE PLAN DECISION SUPPORT SYSTEM FOR PEOPLE WITH DISABILITIES
FINAL REPORT
Submitted by:
Berkeley Planning Associates
440 Grand Avenue, Suite 500
Oakland, CA 94610

Submitted to:
Agency for Health Care Policy and Research
2101 East Jefferson Street
Rockville, MD 20852

Contract Number 282-94-2032
Frantz Wilson

" "

The complete ILRU Web site was developed with support from grants from the Department of Education. However, its contents and the opinions expressed do not necessarily represent the policy of the Department of Education, and no endorsement by the Department should be assumed. ILRU is a program of TIRR (The Institute for Rehabilitation and Research), a nationally recognized medical rehabilitation facility for persons with disabilities.

| Home | Projects | Publications | Training | What's New |

©2005 ILRU Program, All rights reserved
ILRU
2323 S. Shepherd, Suite 1000
Houston, Texas 77019
713.520.0232 (Voice/TTY) 713.520.5785 (Fax)
ilru@ilru.org

Last Modified: 11-8-04