GenAI needs to gain cultural fluency like humans: Amazon CTO

Las Vegas: In the coming years, culture will play a crucial role in how generative Ai is designed, deployed and consumed, Amazon CTO Dr Werner Vogels has said.

Large language models (LLMs) trained on culturally diverse data will gain a more nuanced understanding of human experience and complex societal challenges in 2024.

“This cultural fluency promises to make generative AI more accessible to users worldwide,” Vogels said during the AWS ‘re: Invent’ conference here.

For LLM-based systems to reach a world-wide audience, they need to achieve the type of cultural fluency that comes instinctively to humans.

In a paper published earlier this year, researchers from Georgia Institute of Technology demonstrated that even when an LLM was provided with a prompt in Arabic that explicitly mentioned Islamic prayer, responses were generated that recommended grabbing an alcoholic beverage with friends, which isn’t culturally appropriate.

According to Vogels, a lot of this has to do with the training data that’s available.

“Common Crawl, which has been used to train many LLMs, is roughly 46 per cent English, and an even greater percentage of the content available — regardless of language — is culturally Western (skewing significantly towards the United States),” he noted.

In the past few months, non-Western LLMs have started to emerge: Jais, trained on Arabic and English data, Yi-34B, a bilingual Chinese/English model, and Japanese-large-lm, trained on an extensive Japanese web corpus.

“These are signs that culturally accurate non-Western models will open up generative AI to hundreds of millions of people with impacts ranging far and wide, from education to medical care,” the Amazon CTO emphasised.

Just as humans learn from discussion, debate, and the exchange of ideas, LLMs need similar opportunities to expand their perspectives and understand culture.

According to him, two areas of research will play a pivotal role in this cultural exchange.

One is reinforcement learning from AI feedback (RLAIF), in which a model incorporates feedback from another model.

In this scenario, different models can interact with each other and update their own understandings of different cultural concepts based on these interactions.

“Second is collaboration through multi-agent debate, in which multiple instances of a model generate responses, debate the validity of each response and the reasoning behind it, and finally come to an agreed upon answer through this debate process. Both areas of research reduce the human cost it takes to train and fine-tune models,” Vogels noted.

As LLMs interact and learn from each other, they will gain more nuanced understandings of complex societal challenges informed by diverse cultural lenses, he added.

IANS

North Korea sent 200 long-range artillery pieces to Russia, additional supply likely

Seoul: North Korea is estimated to have sent about 200 pieces of long-range artillery to Russia and is likely to send more troops and weapons in support of Moscow's war...

Macron’s Paris soiree brings together PM Modi, US V-P Vance

Paris: French President Emmanuel Macron greeted Prime Minister Narendra Modi with a friendly hug upon his arrival in Paris for a dinner at the Elysee Palace. Macron greeted Modi upon...

Communal social media post over AAP’s defeat stirs controversy in Mysuru; accused detained

Mysuru (Karnataka): Karnataka Police have detained one person in connection with a controversial social media post making communal comments against a particular community while celebrating the defeat of the Aam...

IICC chief Khurshid and Bihar MLA Iman address a grand India diaspora event in Riyadh

RIYADH: Senior Indian politician and Congress stalwart Salman Khurshid, former Minister of External Affairs, has lent his support to open several chapters of the India Islamic Cultural Center (IICC) in...

BJP’s notice to party’s veteran minister Anil Vij in Haryana

Chandigarh: Haryana’s senior-most minister and seven-time lawmaker Anil Vij was issued a show cause notice by the BJP on Monday for making public statements against the Chief Minister and the...

Foreign Affairs Advisor Hossain to meet EAM Jaishankar in Muscat: Bangladesh media reports

Dhaka :Touhid Hossain, the Foreign Affairs Advisor to the interim government in Bangladesh led by Muhammad Yunus, is expected to meet External Affairs Minister (EAM) S. Jaishankar on the sidelines...

2 pc rise in vote share a step forward: Cong on Delhi election defeat

New Delhi: Congress National Spokesperson Ragini Nayak on Monday acknowledged the party's underwhelming performance in the Delhi Assembly elections, where 67 of its 70 candidates lost their security deposits. However,...

Student from PM Modi’s constituency calls ‘Pariksha Pe Charcha’ an ‘unforgettable experience’

Varanasi: Students from across India participated in Prime Minister Narendra Modi's flagship event, 'Pariksha Pe Charcha' (PPC) 2025, expressing their excitement and appreciation for how the interaction helped them stay...

Trump says he will announce 25 pc duties on steel, aluminum imports; threatens more to come

New York: US President Donald Trump has said that he will announce a 25 per cent duty on all steel and aluminum imports, a long-standing contentious category of trade for...

No one has power to displace Palestinians: Turkish President

Istanbul: Turkish President Recep Tayyip Erdogan said that no one has the power to displace Palestinians from their homeland. "No one has the power to expel Gazans from their ancient...

Will rename Mustafabad to Shivpuri or Shiv Vihar: Delhi BJP MLA

New Delhi: The newly elected BJP MLA from Mustafabad, Mohan Singh Bisht, on Sunday said that the Assembly constituency would soon be renamed to Shivpuri or Shiv Vihar. He won...

Meta likely to lay off thousands of employees, says leaked memo

New Delhi: Tech giant Meta is expected to lay off around 3,000 employees, which is about 5 per cent of its total workforce, as per a leaked internal memo, reports...

Read Previous

Minors kidnap for computer, kill child after giving him rasgullas, cold drink

Read Next

India achieved emission intensity-related target 11 years ago: PM Modi at COP28

WP2Social Auto Publish Powered By : XYZScripts.com