Showing posts with label language bias. Show all posts
Showing posts with label language bias. Show all posts

Tuesday, August 13, 2024

Translations: Lessons learned for better outcomes

Translating documents, advertisements or other materials can be a real headache for many organizations, especially with periodic news stories reporting on the explosive growth of groups, like Asians and Latinos. For example, one recent report by the Census Bureau cited in Texas Tribune tells us that Asians now have a higher population growth rate in Texas (5.5%) – faster than the overall population growth rate for the state of 1.6 percent.[1]  Latinos, however, continue to fuel a majority of the population growth in Texas and many U.S. communities.  The projected population growth in Texas is vividly illustrated by Figure 1 below. [2]


 Figure 1 Projected Texas Population by Race/Ethnicity

  












According to these projections of the Texas population by the Texas Demographic Center (January 2019), the period between 2020 and 2050 will realize a dramatic multicultural population boom of 108.9 percent for Non-Hispanic Blacks, 509.7 percent for Non-Hispanic Asians, and 113.4 percent for Hispanics – indeed, a significant change that is likely to  significantly increase the demand for language translation services. The same report revealed that four of the top ten counties in Texas that are projected to absorb this growth are located in the Dallas/Ft. Worth metro area (see Table 1 below):  Collin County (1.7 million persons); Denton County (1.7 million persons); Dallas County (1.4 million persons); and Tarrant County (1.4 million persons).  If your organization serves or plans to serve Asian and Latino persons with your services or products, a sound translation strategy will be especially important. 

Indeed, one medical institution recently contacted me with an urgent question:  With so many Asian groups in Dallas County, which languages should be targeted for translation?  This sense of urgency is especially acute in industries related to healthcare, legal, and public safety where even minor errors in translation can have serious consequences. For example, communications and medical interventions in linguistically diverse U.S. communities during the Covid-19 pandemic were compromised by the absence of information regarding the racial-ethnic identity and language characteristics of highly impacted communities.    Indeed, about 22 Asian countries are represented in North Texas by the Census Bureau while Latinos are represented by 21 countries – numbers that clearly underscore the need for translation support.  Moreover, Asian countries include hundreds of languages with different dialects.[3]  And while Spanish is common to Spanish-speaking countries, their dialects are known to vary across these countries.[4]

 Table 1: Top 10 Texas Counties with Greatest Numeric Change between 2010 and 2050

 

 The translation strategy that an organization adopts, however, can produce negative outcomes and undermine community goodwill if not done carefully and professionally.  To clear up some of the confusion associated with translations, I would like to share some lessons learned from my 45 years of practical experience in conducting surveys and experiments with Latinos and Asians for a broad spectrum of private, public and academic clients.  While I am not a linguistics expert, I have studied the use of language in these studies, and this experience has been reinforced by teaching undergraduate and graduate courses in Hispanic marketing, multicultural research methods, survey research methods, statistics, and mass communications. Thus, the lessons learned are not just subjective impressions about language usage but grounded in academic and real-world experiences. Although I have addressed language translation issues in the past, recent events pointed to the need for an update on this topic.

 Lesson 1:  The language that Latinos and Asians use to communicate is not uniform and shaped by key characteristics such as age, nativity, income and education. 

For example, a non-English or foreign language is more likely to be used by persons who are foreign-born, older, less educated and lower income. Persons who are are more likely to communicate in English include persons who are native born, younger, higher income and more educated groups. Language usage is also likely to vary in terms of the context:  reading a book, listening to a medical provider, watching television, or talking with friends or family members.  Consequently, prior to initiating a translation process, it is very important to identify the specific target audience within the Latino or Asian household or communities that the translated document is designed to benefit. A good rule of thumb is to provide both English and native-language documents to ensure adequate coverage of all members of a household.

 Lesson 2:  A head nod is not sufficient to confirm understanding of a translated document.

 It is often the case that a Latino or Asian person is presented a form to complete a transaction or register for a program or service.  Attorneys, healthcare providers, and mortgage companies often present documents that need signatures on documents that involve important decisions. In such circumstances, the customer is typically asked if they understand what is being explained or what they are reading, and a head nod or “yes” response is usually accepted as confirmation that the information was “understood.”  But is this type of confirmation a valid one?   Perhaps not if there is no follow-up to determine that the information was really understood.  Latinos and Asians, especially immigrants, will often confirm that they understand an instruction or a document to save face and not admit that they lack the ability to read or understand that language. Consequently, it is important to ask these customers to explain or demonstrate their comprehension of an instruction by asking them to repeat in their own words what the instruction means or asking them to physically demonstrate their comprehension. In a healthcare setting, for example, it would be advisable to ask a Latino or Asian to repeat, in their own words, the instructions for taking their medication(s) – clearly a more valid measure of comprehension than a simple head nod.

 Lesson 3:  Translators are not the last word on language translations.

 Over the past years, I have used translators for a variety of tasks using different languages and value the function that they serve. In one national study of Latinos, African Americans and Asians, our firm conducted surveys in five languages (English, Spanish, Chinese, Korean and Vietnamese) using mail, online and telephone survey methods – quite a challenge indeed. Over the years, I have learned to appreciate the value of a certified translator with experience in the subject matter at hand, whether legal, healthcare, insurance, etc. – which helps to reassure clients about the accuracy of the translation. However, it is a mistake to think that your job is done when a translator submits their finished product.  In addition to the accuracy of the translated document, it is equally important to know who the intended audience will be and their ability to read and understand the document.  Translators do not always know who the intended audience is and sometimes produce documents whose reading difficulty level is too high or include words or phrases that are unfamiliar to the intended audience. Mandy Sha, a Chinese research colleague of mine, was part of a research team that conducted a usability test of a Census Bureau questionnaire with Chinese respondents who could read and write in Chinese but had limited English-language proficiency. The investigators discovered several problems with the translated questionnaire, such as sentence structure or verb tense, grammar, lack of context, name order, validation rules and navigation instructions. [5]  By conducting a copy test, pilot test or usability study of a translated document, one can have the added assurance that the appropriate communication has been established with the targeted consumer.    Hence, your target audience, not the translator, should have the last word on the acceptability of a translated document or other material.

 Lesson 4:  Speaking a language is not an automatic qualifier for reading or writing in that language.

 Naïve marketers are often surprised to observe that Latinos or Asians can be conversing in their native language quite comfortably but may have difficulty when asked to read or write a document in that language. What some marketers fail to understand is that a language usually includes four basic functions --  reading, speaking, writing, and listening --  and proficiency in one of these functions does not necessarily mean proficiency in the other functions. In addition, many immigrants coming from Asian or Spanish-speaking countries may lack formal education and cannot read or write in any language, while more educated immigrants may be more literate in their native language.  By better understanding the origins and educational background of Latinos and Asians, marketers can develop communications that will be understood by their target audiences. Thus, one should always consider the language function being utilized when evaluating a translated document. It is insufficient to just ask a Latino or Asian person in which language they prefer to communicate since it is important to know whether their language preferences are dependent on the language function (i.e., reading, speaking, writing, listening) and the specific task or activity that they are engaged in (i.e., watching television, reading a book, talking with family, listening to music, conversing with medical staff).  So, learn to be situation specific in asking Latinos or Asians which language they prefer for communications.

 Lesson 5:  While the U.S. Census Bureau collects language usage data about Asians and Latinos, it can be misleading.

 Organizations often quote language statistics collected by the Census Bureau as evidence about the number of native-language households that reside in the U.S. at any point in time.  The quality of this language data, however, is limited in several ways.  First, one question in the American Community Survey asks:  “Does this person speak a language other than English at home?” If the question is answered “yes,” then the next question that follows is: “What is this language?  Thus, we learn from these two questions the number of persons that speak Spanish or another language.  But it does not ask how well Spanish or other non-English languages are spoken – referred to as language proficiency.  Thus, if a person utters one word in Spanish, then they are classified as a Spanish speaker or Spanish-language household. How well they speak Spanish does not seem to matter here. 

English is the only language where proficiency is asked:  “How well does this person speak English?” – to which one is provided four options:  “Very well,” “Well,” “Not well,” and “Not at all.”  While this type of language proficiency question is useful in providing some guidance on how well a person speaks the English language, other research that I have summarized elsewhere shows that Latinos tend to over-estimate their language skills on self-reported measures like the one used by the Census Bureau – a consequence of social desirability.  That is, native-born Latinos who are more English-language proficient often want others to think that they speak Spanish better than they actually do.  Immigrants, who are more Spanish-language proficient, often want others to think that they speak English better than they actually do.  Even when they claim proficiency in both languages, most native-born Latinos will choose an English-language interview when given a choice, while most Latino immigrants will choose a Spanish-language interview.  Hence, the language that a Latino chooses when provided a choice is a more valid indicator of their language dominance than their self-reported language proficiency.  Our experience suggests that Latinos should always be provided the choice of English or Spanish when asked to complete a task – such as an interview or a written document. This simple procedure will usually assure that you will get a more valid response.  Thus, the Census Bureau language questions, while useful, are crude measures of language behavior that should be used cautiously when evaluating the language behavior of U.S. Latinos or Asians.

 Lesson 6:  Using Latino or Asian employees to translate documents is risky.

 As a shortcut, some companies will utilize Latino or Asian employees to translate documents or interpret on the spot when the situation demands it.  Unless you know the training and education of that employee, you are taking unnecessary risks in assigning them this responsibility. Latinos or Asians who are born in the U.S. rarely study their native language formally in school and rely on the native language that they have heard or used growing up in their communities – often a mixture of English and a native language.  Important documents that relate to personnel procedures, healthcare, safety, insurance or legal matters should only be translated by a certified translator and evaluated by a usability test to ensure that persons in the target audience understand the translated documents or other visual aids.  Experience also suggests that graphic symbols, such as those used in hazard warning signs, also have cultural components that may not communicate the same message to culturally diverse groups. Copy or usability testing is especially important with exhibits that include hazard or warning signs that often rely on graphic symbols since they are used to warn or prevent injuries or accidents. Employees who live in the local area and have some familiarity with a native language can be helpful in identifying informal words or phrases spoken by local Latinos or Asians instead of more formal words or phrases.  For example, automóvil is the formal word uses for automobiles although the word “carro” is often used by some Mexican residents.  

 Lesson 7:  Knowing a language does not necessarily mean that you know the culture.

 In the employment world, many occupations require proficiency in one or several languages.  While proficiency in a language other than English is a definite asset in many jobs, it should not be confused with knowledge of a particular culture.  It is not uncommon, for example, for a foreign-born Latino or Asian with an excellent command of their native language to receive more consideration for a job than a similarly educated Asian or Latino whose native language proficiency is not as well polished --  the assumption being that a higher language proficiency also means more knowledge or experience with the culture.  This assumption may not necessarily be a valid one since a native-born Latino or Asian may indeed have more knowledge of the U.S. Latino or Asian culture than a foreign-born Latino or Asian who happens to communicate well in a native language. If the job involves responsibilities with U.S. Latino or Asian consumers, then knowledge of the U.S. Latino or Asian culture should be just as important in employment decisions as proficiency in a language.

 Lesson 8:  Language ability depends on sight and sound as well.

 My experience in conducting focus groups with Latinos and Asians has shown that their ability to understand a written document or verbal instruction is sometimes influenced by limitations related to visual acuity and hearing impairments.  Indeed, past research on vital statistics reveals that Latinos (11.2%), Blacks (10.0%), and Asians (9.7%) have trouble hearing, while vision limitations were reported for Blacks (9.3%), Latinos (9.4%), and Asians (5.7%). [6] Persons with vision or hearing limitations will not readily admit when they are unable to see very clearly, but an astute observer will notice non-verbal cues that suggest a vision problem.  Similarly, hearing impairments can be subtle and not usually something that will be readily apparent.  As a moderator, I have addressed such issues by reading a document out loud so that everyone can hear and understand the instructions and ensure that any written documents are provided in large fonts to enhance their readability. Rather than embarrass a person because they cannot see or hear very well, it makes more sense to offer options that will allow all persons to participate in the task or activity. 

 Lesson 9:  Is your target audience really diverse? How many languages need to be translated?

Occasionally, I have received calls asking how many languages need to be included in translating important documents, especially as it concerns Asian communities.  Because the Census Bureau data clearly shows “wide diversity” in some communities that represent multiple Asian countries, it becomes perplexing for some decision makers to determine which languages should be targeted for translation.  The solution, however, is rather simple.  The Census Bureau provides tables that show the country of origin represented in any community by geographic areas in the U.S. and its territories – currently there are 22 Asian countries and 22 Spanish-speaking countries counted by these Census tables. After consulting these tables, for example, one can just focus on translating a document for the countries that account for a majority of the population of Asian persons.  Although Spanish would be the only relevant language for the 22 Spanish-speaking countries, one can expect variations in dialects, idioms, and vocabulary depending on the concentration of these groups in any community. Knowing that a community is mostly Mexican, for example, might be a consideration for the translator to utilize idioms or vocabulary that are more commonly used by Mexican-origin persons.

 Lesson 10:  Using accents in Spanish translations or diacritical marks in Asian languages is essential.

Accents in Spanish-language text and diacritical marks in Asian languages are important linguistic features that help to guide the reader in the proper pronunciation and interpretation of a word or phrase.[7]  Without these linguistic features, foreign-language speakers are likely to mis-pronounce or misinterpret words or phrases.  Special keyboards are typically used to produce accents or diacritical marks. A translated document that lacks these linguistic features suggests that the translator was not adequately trained or lacked the proper tools to complete this task. You should avoid sharing translated documents with Latino or Asian persons without the required accents or diacritical marks. 

Lesson 11:   Language gets more complicated for messaging in advertisements.

If your translation efforts are focused on advertising messages, you will be faced with additional challenges that will likely exceed the skill set of a translator since this is not their area of expertise.  Indeed, you will need the help of a qualified advertising or public relations professional that has been trained in this area.  You will now have two areas of concern --  language translation and persuasive messaging – which is likely to vary considerably depending on the demographic subgroups that you are targeting.  For example, younger Latinos or Asians will likely be more responsive to an English-language advertisement although it has become popular for youths to mix English and a native-language in their communications. Older Latinos or Asians will likely be more responsive to advertisements that do not mix the languages which could be perceived as an indifference to proper grammar in that language.  To ensure the acceptance and approval of an advertisement, you should plan to conduct focus group copy testing of these ads before they are launched with the appropriate target audience to remove any uncertainties.

Lesson 12:  Providing language options also helps to build rapport.

 I have learned from past experiences that some organizations consider it burdensome to provide support in a language other than English to their customers – citing such issues as additional costs related to translators, bilingual staff, printing, advertisements and customer support.  However, one important benefit of providing support for non-English languages is the rapport that is established with Latino and Asian persons.  In our survey practice, for example, cooperation rates among Latino or Asian respondents are often improved when they are given the choice of a native language or English language interview – especially if the interview includes a foreign-born person.  Improved rapport not only leads to higher cooperation rates, but often results in the successful completion of the entire interview and better quality data that results from better comprehension of the survey questions. With higher survey response rates, the additional costs for support a language other than English are often justified.

 Note:  I welcome your feedback on the post.  Please send all comments or requests for a pdf version to edward@rinconassoc.com


Reference Notes


[1] Garcia, B.  (June 2024).  Fastest growing group in Texas:  Asian Americans.  Texas Tribune, Accessed at: https://www.texastribune.org/2024/06/26/texas-asian-american-growth-census/ 

[2] Potter, L., Valencia, L., Robinson, S. (January 2019). Texas Population Projections 2010 to 2050, Texas Demhttps://en.wikipedia.org/wiki/Languages_of_Asiaographic Center.  Accessed at:  https://www.demographics.texas.gov/

[3]  Wikipedia (2024). Languages of Asia,  Accessed at: https://en.wikipedia.org/wiki/Languages_of_Asia

[4] (August 2024).  Spanish dialects and varieties.  Wikipedia.org, Accessed at:  https://en.m.wikipedia.org/wiki/Spanish_dialects_and_varieties

[5] Wang, L., Sha, M. and Yuan, M. (2017).  Cultural fitness in the usability of U.S. Census Internet survey.  Survey Practice, Vol. 10, No. 3, 2017.  Accessed at www.surveypractice.org

[6] Rincon, E.T.  (2020).  The Culture of Research.  Publisher:  Writers Marq LLC.

[7] Thesaurus.com (April 2022) 12 Types Of Diacritical Marks And How To Type Them, Thesaurus.com, Accessed at: https://www.thesaurus.com/e/grammar/diacritical-marks/



Wednesday, June 24, 2015

Some Simple Truths About Language Usage Among U.S. Latinos


Give me a break  -- 55 million Latinos in the U.S. and confusion still lingers about the best language to use when communicating with Latinos?  Corporate America continues to pour millions of dollars into Spanish-language media, documents, and campaigns despite the fact that Latinos are becoming increasingly more English-dominant, and audiences for Spanish-language television, radio and print have been losing audiences for some time. Apparently, few marketers have come to grips with the demographic reality that two-thirds of U.S. Latinos are native-born and depend primarily on English-language communications.

This paradox has lingered for two main reasons.  First, too many self-serving marketers and media shops have sold the Spanish language as the single gateway to the Latino community in the U.S., reinforced by a history of biased, self-serving research studies.  Secondly, our nation’s academic institutions continue to produce graduates with little knowledge about the language and other characteristics of U.S. Latinos. In short, the collective Latino IQ of Corporate America is embarrassingly low and unable to distinguish fact from fantasy.

To clear up some of this confusion, I would like to share some simple truths about language usage gleaned from my 36 years of practical experience in conducting surveys and experiments with Latinos for a broad spectrum of private, public and academic clients. I am not a linguistics expert, but have studied the use of language in these studies. This experience has been reinforced by teaching undergraduate and graduate courses on Hispanic marketing, survey research, statistics, and mass communications.  Thus, these simple truths are not just subjective impressions about language usage, but grounded in academic and real-world experiences.

1. Not all Latinos communicate in Spanish.
We have heard and read about it for many years – Latinos have better recall of advertisements in Spanish, Latinos make love in Spanish, the love affair with Spanish telenovelas, and so on.  As a result, marketers continue to pour millions of advertising dollars into Spanish-language media and communications believing that they are reaching all segments of Latinos. However, substantial research evidence confirms the following two facts:
·       Spanish-language audiences are comprised primarily of recent immigrants who are generally less educated, have lower incomes, are the least connected to the Internet, and primarily apartment dwellers.
·       By contrast, native-born Latinos are more dependent on English-language communications,  and generally include children, voters, higher income earners, homeowners, the more highly educated and Internet connected, and professionals.

Although many marketers may prefer to bury their heads in the sand and remain loyal to their Spanish-language strategies, the organizations that are paying for advertising and media placements should be informed that their Spanish-language advertisements may not be reaching a sizeable segment of Latino consumers.

2. Do you understand what I am saying?
It is often the case that a Latino customer is presented a form to complete a transaction or register for a program or service.  Attorneys, healthcare providers, and mortgage companies often present documents that need signatures on documents that involve important decisions. In such circumstances, Latinos are typically asked if they understand what is being explained or what they are reading, and a head nod or “yes” response is usually accepted as confirmation that the information was “understood.”  But is this type of confirmation a valid one?   Perhaps not in some cases,  because there is no follow-up evidence that the information was really understood.  Latinos, especially immigrants, will often confirm that they understand an instruction or a document to save face and not admit that they lack the ability to read or understand that language. Consequently, it is important to ask a Latino customer to explain or demonstrate their comprehension of an instruction by asking them to repeat in their own words what the instruction means, or asking them to physically demonstrate their comprehension. In a healthcare setting, for example, it would be advisable to ask a Latino to repeat, in their own words, the instructions for taking their medication(s)  – clearly a more valid measure of comprehension than a simple head nod.

3. Translators are not the last word on language decisions.
Over the past years, I have used translators for a variety of tasks and languages, and appreciate the function that they serve. With few exceptions, I always use a certified translator with experience in the subject matter at hand, whether legal, healthcare, insurance, etc. – which helps to affirm the accuracy of the translation. However, it is a mistake to think that your job is done when a translator submits their finished product.  In addition to the accuracy of the translated document, it is equally important to know who the intended audience will be and their ability to read and understand the document.  Translators do not always know who the intended audience is, and sometimes produce documents whose reading difficulty level is too high, or include words or phrases that are unfamiliar to the intended audience. By copy testing or pilot testing the translated document, one can have the added assurance that the appropriate communication has been established with the Latino consumer.    
Hence, your customer, not the translator, should have the last word on the acceptability of translated documents.

4. The use of Spanish is decreasing, not increasing.
Although media stories often talk about the large numbers of Latinos that watch Spanish-language television, the media hype contradicts what has been known by demographers for the past decade. That is, the number of Latino immigrants in the U.S. – the primary audience for Spanish-language media – has been decreasing in recent years. As explained by the Pew Research Center, the demand for Spanish-language communications of all types is expected to decrease in the coming years, while the demand for English-language communications will increase as the children of the immigrants comprise a larger component of future population growth.  Of course, this does not mean that an organization should not offer or eliminate Spanish-language support; on the contrary, it underscores the importance of also including English-language communications when reaching out to Latino consumers.

5. Speaking Spanish is not an automatic qualifier for reading or writing in Spanish.
Naïve marketers are often surprised to observe that Latinos can be conversing in Spanish quite comfortably, but may have difficulty when asked to read or write in Spanish. What some marketers fail to understand is that a language usually has at four basic functions or components --  reading, speaking, writing, and listening --  and proficiency in one of these functions does not necessarily mean proficiency in the other functions. In addition, many immigrants from Mexico lack formal education and cannot read or write in Spanish, while other immigrants from Latin America tend to be more highly educated and literate.  By better understanding the origins and educational background of Latinos, marketers can develop communications that will be understood by Latinos in their target audience. Thus, one should always consider the language function being utilized when evaluating a translated document.

6. While the U.S. Census Bureau collects language data, it can be misleading.
Organizations often quote language statistics collected by the Census Bureau as evidence about the number of Spanish-speaking households that reside in the U.S. at any point in time.  The quality of this language data, however, is limited in several ways.  First, one question in the American Community Survey (2015) asks:  “Does this person speak a language other than English at home?” If the question is answered “yes,” then the next question that follows is:  “What is this language?  Thus, we learn from these two questions the number of persons that speak Spanish and other languages as well.  But it does not ask how well Spanish is spoken, or the extent to which that person uses Spanish in any given task.  Presumably, if a person utters one word in Spanish, then they are considered a “Spanish speaker.”

The only other language question included is:  “How well does this person speak English?” – to which one is provided four options:  “Very well,” “Well,” “Not well,” and “Not at all.”  While this type of language proficiency question is useful in providing some guidance on how well a person speaks the English language, other research that I have summarized elsewhere shows that Latinos tend to over-estimate their language skills on self-reported measures like the one used by the Census Bureau – a consequence of social desirability.  That is, native-born Latinos who are more English-language proficient often want others to think that they speak Spanish better than they actually do.  Immigrants, who are more Spanish-language proficient, often want others to think that they speak English better than they actually do.  Even when they claim proficiency in both languages, 9 in 10 native-born Latinos will choose an English-language interview when given a choice, while 9 in 10 immigrants will choose a Spanish-language interview.  Hence, the language that a Latino chooses when provided a choice is a more valid indicator of their language dominance than their self-reported language proficiency.  Our experience suggests that Latinos should always be provided the choice of English or Spanish when asked to complete a task – such as an interview or a written document. This simple procedure will usually assure that you will get a more valid response.  These Census Bureau language questions, while useful, are crude measures of language behavior that should be used cautiously when evaluating the language behavior of U.S. Latinos. Click on this link to read the white paper entitled “Are Latinos Over-Estimating Their Language Abilities with Self-Reported Measures?”  http://www.rinconassoc.com/category/publications  

7. Employers take great risks when using Latino employees for translations or language advice. 

As a shortcut, some companies will utilize Latino employees to translate documents or interpret on the spot when the situation demands it.  Unless you know the training and education of that employee, you are taking unnecessary risks in assigning them this responsibility. Latinos that are born in the U.S. rarely study Spanish formally in school and rely on the Spanish that they have heard or used growing up in their communities – often a mixture of English and Spanish.  Important documents that relate to employee personnel procedures, healthcare, safety, insurance or legal matters should only be translated by a certified translator and copy-tested to ensure that employees understand the translated documents or other visual aids.  Experience also suggests that graphic symbols, such as those used in hazard warning signs, also have cultural components that may not communicate the same message to culturally-diverse groups. Copy testing is especially important with signage that relies on graphic symbols since they are often used to warn or prevent injuries or accidents. 

8. Knowing a language does not necessarily mean that you know the culture. 
In the employment world, many occupations require proficiency in one or several languages.  While proficiency in a language other than English is a definite asset in many jobs, it should not be confused with knowledge of a particular culture.  It is not uncommon, for example, for a foreign-born Latino with an excellent command of the Spanish language to receive more consideration for a job than a similarly educated Latino whose Spanish proficiency is not as well polished --  the assumption being that a higher language proficiency also means more knowledge of the culture.  This assumption may not necessarily be a valid one since a native-born Latino may indeed have more knowledge of the U.S. Latino culture than a foreign-born Latino who happens to communicate well in Spanish. If the job  involves responsibilities with U.S. Latino consumers, then knowledge of the Latino culture in the U.S. should be just as important in employment decisions as proficiency in a language.

9.  Are Latinos really diverse?
I often hear statements about the wide diversity in Latino communities, a reference to the numerous countries of origin represented throughout the U.S.   Indeed, the U.S. Census Bureau tells us that about 22 countries are represented in the category known as Hispanic or Latino.  A look at the Latino population in some geographic areas, however, would lead one to re-think the use of the word “diversity.”  For example, the State of Texas included  10.1 million Latinos in 2013, representing a broad variety of Spanish-speaking countries.  However, fully 88 percent of Texas Latinos were of Mexican origin – not exactly the picture of diversity. Decisions regarding language usage should consider the primary countries of origin represented by the Latinos living in a particular community since the type of Spanish utilized can vary by country of origin.  How can you find out about the country of origin for a particular community?  It’s easy – just visit the Census Bureau Factfinder web site at http://factfinder.census.gov/faces/nav/jsf/pages/index.xhtml to obtain the Latino country of origin for any city, county, metropolitan area or state.

10.  Language ability depends on sight and sound as well.


My experience in conducting hundreds of focus groups with Latinos has shown that their ability to understand a written document or verbal instruction is sometimes influenced by limitations related to their visual acuity and hearing impairments.  Latinos will not readily admit when they are unable to see very clearly, but an astute observer will notice non-verbal cues that suggest a vision problem.  Similarly, hearing impairments can be subtle and not usually something that will be readily apparent.  As a moderator, I have addressed such issues by reading a document out loud so that everyone can hear and understand the instruction, and ensure that any written documents are provided in large fonts to enhance their readability. Rather than embarrass a person because they cannot see or hear very well, it makes more sense to offer options that will allow all persons to participate in the task or activity. 

Monday, April 29, 2013

The Texas Recipe for Muting the Hispanic Voice in Public Opinion Polls



If you are a tax-paying Texas resident, should your opinion matter in decisions related to publicly-funded programs or services in Texas?  Of course, you may say, the opinions of all Texas residents are important.  But one Texas state agency thinks that it is acceptable to exclude Spanish-speaking Hispanics from state-funded public opinion polls that are used to decide how tax dollars are spent.  I would like to share the details of an actual case study that vividly illustrates how one Texas agency is being allowed to silence the voice of Texas Hispanics in its public opinion polls.
The State of Texas has plans to spend billions of dollars to improve their transportation system, including the possibility of high speed rail. To ensure that the improved system meets the needs and expectations of Texas residents, the Texas Transportation Institute has the responsibility for conducting important surveys of Texans that reside in specific geographic areas, or corridors, that are likely to be impacted by these improvements.
A recently released report by the Texas Transportation Institute for the first of these two surveys, conducted during the Fall of 2012, provides concrete evidence that the voice of Texas Hispanics was muted by the survey planners.  Indeed, Hispanics represented only 20 percent of the survey respondents, despite their current representation of 38 percent in Texas (American Community Survey, 2011).  Even worse, only 19 percent of the few Hispanics included in the study were interviewed in Spanish – which compares poorly with other state surveys that have shown that 50 to 67 percent of Hispanics prefer a Spanish-language interview.
How could this occur, especially when the study design was reviewed by a “panel of experts” at the Institute?  A careful review of the study methodology reveals several missteps in the planning and execution of this survey:

  • The 16,000 households selected as respondents received only an English-language version of the survey.
  • The cover letter that was included with the English-language survey was provided only in English, and did not offer respondents any support to complete the survey in another language.
  • A question that asked respondents to identify their race-ethnic background provided only one ethnic identifier for Spanish-speaking respondents -- “Hispanic” – which could partly explain the under-count of these respondents because other labels are often preferred over the “Hispanic” option.
  • A call center was supposedly set up to receive incoming calls from survey respondents that had questions or needed Spanish-language support. But this call center probably received few calls from Spanish-speaking respondents since the cover letter did not provide the needed contact information.  Moreover, the report did not include a copy of the Spanish-language telephone survey that was supposedly used by the survey vendor's call center to capture incoming calls by the survey respondents.  
  • The study design required that automated advanced calls (or “robo calls”) be made to the selected households prior to the survey mailing.  Automated calls are a recognized nuisance from telemarketers and political campaigns that often discourage response rates to legitimate public opinion polls.
  • The report indicated that the survey “participation rate” was 34.6 percent – a rate that appears subjectively created and not recognizable by the American Association of Public Opinion Research (2011).  Instead, the overall survey response rate was more likely to be a much lower 9.7 percent (1,559 completions /16,000 invited participants) – not surprising given the recognized shortcomings in the methodology.
  • While the vendor acknowledged that Hispanic respondents were significantly under-represented and non-Hispanic whites were over-represented, no explanation was provided about the potential causes or consequences of this imbalance.
  • The fact that the survey planners ignored a previous warning about the potential flaws in the survey methodology suggests that the poor survey outcomes did not result from just simple carelessness.
         To make matters worse, the same survey vendor was awarded a second contract to conduct another public opinion poll of Texas residents using the same flawed methodology.  Why are state officials allowing such flawed practices to take place, especially at a time when the state’s population is being heavily impacted by the growing Hispanic population?
As one of the vendors that competed for both survey contracts, Rincón & Associates LLC monitored both competitions with some concern. In both competitions, state procurement staff decided to award the contract to the lowest bidder, which may not have been the brightest decision given the poor study outcomes.  As both studies required a mixed-mode survey methodology that few U.S. companies were capable of executing, more weight should have been given to proven experience using this specialized methodology with diverse communities in Texas. Procurement staff did not have to settle for the lowest bidder as other Texas vendors were ready, willing and able to conduct both studies.
Fortunately, an investigation was initiated on March 3, 2013 to find out why a state agency like the Texas Transportation Institute is allowed to deliberately design a study that minimizes the participation of Hispanic residents, especially Spanish speakers.  The outcome of this investigation is important because it could either (a) allow other state agencies to exclude Spanish-speaking Hispanics from state-funded studies, or (b) raise the standards of research for all state agencies to ensure that all state-funded studies provide adequate Spanish-language support.
The practical significance of this issue cannot be over-stated. Spanish-speaking residents are often the most likely to be overlooked in the delivery of public services, the most likely to receive the lowest quality services, and show distinctive attitudes or values that differ significantly from English-speakers.  Thus, excluding Spanish-speakers from opinion polls can lead to more positive satisfaction ratings than is actually the case, and result in erroneous public policy decisions.
It is time to require a higher standard for public opinion polling in communities that are linguistically and culturally diverse. Although professional research organizations have always defined quality and ethical standards for the research industry, it is apparent from the case just discussed that public agencies may not feel the need to follow these guidelines.  Following are a few ideas suggested from our experiences with public agencies like the Texas Transportation Institute:
  • Research firms that compete for opinion polls in the public sector should be required to produce evidence that they have the staff, facilities and past experience to conduct polls in linguistically and culturally diverse communities. If a research firm does not produce a representative sample of such communities in a contracted study, they should not be rewarded with another contract that utilizes the same flawed methodology.
  • The committee members convened by public agencies to evaluate research proposals may not have the expertise to judge these proposals in terms of their adequacy for diverse communities. The inclusion of experts with experience in conducting polls in diverse communities may have prevented the missteps in the Texas A & M studies.
  • In the haste to award a contract to the lowest bidder, proposal evaluators do not regularly check the references provided by the different bidders, but oddly enough still find a way to rate the relevant experiences of the bidders without this information. Prior to contract award, an audit should be conducted to ensure that such references were verified for all of the vendors that submitted a bid in such competitions.
       It is unclear that the State of Texas got the “best value” by selecting the lowest bidder from outside of Texas. Indeed, what is the economic benefit to Texans when a contract is awarded to a non-Texas vendor whose payrolls, taxes and local spending for goods and services will only benefit another state? 
Legislators and advocacy organizations, especially those that represent the needs of Texas Latinos, should show their concern about public opinion polling practices that minimize or eliminate the voice of the constituents that they represent. Can we afford to remain silent on this issue? 
The more conservative members of the Texas community may believe that all public work should be conducted only in English, and that no special accommodations should be made to non-English speakers. Unless we are willing to also exempt non-English speakers from the payment of taxes as well, then I believe that they should be given the option of voicing their opinions on topics that impact their quality of life.  Although many Hispanics and Asian residents have proficiency in English and their native language, about 50 to 70 percent of these residents still prefer to express their opinions in their native language.  By providing the appropriate linguistic options, public opinion researchers are more likely to establish rapport, increase response rates, and obtain more valid responses to their questions from ethnic respondents – all desirable outcomes for high quality research.     
Texas public agencies, especially the Texas Transportation Institute, must be required to raise their standards when conducting opinion polls of Texas residents, and legislators must take a more assertive role to ensure this outcome. We cannot afford to bury our collective heads in the sand on this issue.