Breaking 23:00 Killer Robots: Guterres Warns of Growing Threat Posed by Autonomous Weapons 22:30 Bharat Semi: Indian Chip Startup Raises $24 Million to Develop AI-Powered Sensors 22:15 Germany: EU Approves UniCredit’s Takeover of Commerzbank in Major Banking Consolidation Move 22:00 Yemen: Riyadh Dismisses Commander of the Military Coalition 21:30 Nvidia: Why Jensen Huang's Departure Could Shake the Entire AI Industry 21:00 Qatar Football: Walid Regragui Emerges as a Leading Candidate for National Team Coaching Job 20:30 Casablanca: Two Minors Sent to Child Protection Centre After Al Jabr School Terror Scare 20:00 Belgium: Romelu Lukaku Announces Retirement From International Football After 16 Years With the National Team 19:30 US Military Reinforcement: Third Aircraft Carrier Arrives in the Middle East Ahead of Trump’s China Summit 19:00 Morocco: Tomato Prices Remain High Despite Suspension of Exports to African Markets 18:30 Yemen: Houthis Advance Within 60 Kilometers of Aden as Government Reinforces Defences 18:00 Happy Passports Index 2026: Morocco Scores 29.7 Points and Ranks 49th 17:30 Casablanca: Building Collapse in Bouchentouf Damages Shops and Three Cars 17:00 AFCON 2027: Morocco Prepare for Crucial Niger Encounter With Qualification in Sight 16:30 South Africa: Seven Western Countries Warn of Rising Kidnapping Threat 16:09 Morocco: ACAPS Seeks Stronger Powers to Prevent Insurance Sector Crises 16:01 Brazil: Carlo Ancelotti Admits More Work Is Needed to Restore the National Team's Competitiveness 16:00 Apple Launches New App: Studying How People Use AI for Health 15:30 Morocco: MP Calls for Cigarette Prices to Reach 100 Dirhams per Pack 15:00 France vs Turkey: Zinédine Zidane Returns to Bordeaux as Les Bleus Secure Nations League Quarter-Final Spot 14:30 South Korea: AI Cheating Fears Prompt Tighter Security Ahead of University Entrance Exam 14:00 AI and Climate Change: UN Warns of Major Opportunities and Growing Environmental Risks 13:45 Israel’s Political Crisis: Eisenkot Accuses Netanyahu of Threatening Democracy 13:30 Anthropic: Three Major Challenges Ahead of Its Potential Stock Market Debut 13:15 GTA VI: Miami Transforms Into Vice City Ahead of the Highly Anticipated Launch 13:00 Morocco: Fuel Prices Drop as Gasoline and Diesel Become Cheaper at the Pump 12:45 Lebanon: US Considers Replacing UNIFIL With Fewer Than 100 International Observers 12:36 OPPO Unveils Photo and AI Innovations in Its New Find X10 Series 12:30 UK: Barrister Suspended for Four Months Over Antisemitic Social Media Posts 12:15 Morocco-US Relations: Mike Waltz to Visit Rabat for Talks on Regional Security and Strategic Cooperation 12:00 Francophonie: Secretary-General Election Postponed by One Year Amid Institutional Reforms 11:45 Amputee Football World Cup 2026: Morocco Beat the United States 2-1 to Reach the Round of 16 10:30 South Africa: Eight Men Shot Dead in KwaZulu-Natal Province 10:15 England: Three Lions Defeat Spain 3-2 in Madrid to End Champions’ Three-Year Unbeaten Run 10:00 Gaza Winter Crisis: Four Nations Demand Entry of 150,000 Tents for Displaced Families 09:56 AS FAR Women: Fouzi Lekjaa Congratulates the Moroccan Club on Its CAF Champions League Triumph 09:45 Angela Merkel: Former German Chancellor Criticizes Disproportionate International Scrutiny of Israel 09:30 Historic Gaza Tour: 20 UN Ambassadors Inspect Hamas Underground Infrastructure 09:15 France-Morocco Security Cooperation: French Police Praise Morocco Following Four Arrests of Internationally Wanted Suspects 09:00 Morocco's Currency Market: Dirham Gains 0.9% Against the Euro as Foreign Reserves Reach MAD 515.6 Billion 08:45 Rwanda: Five European Countries Plan to Establish Migrant Return Centres 08:30 Morocco Weather Forecast for November 16, 2026: Temperatures Reach 35°C in Some Regions

AI coding tools show reliability gaps in structured output tasks

Tuesday 17 March 2026 - 16:00
AI coding tools show reliability gaps in structured output tasks

A new study from the University of Waterloo finds that leading artificial intelligence coding tools still fail in roughly one out of four cases when generating structured outputs, raising concerns about their reliability in real-world software development workflows.

The research, released on March 16 and scheduled for presentation at the International Conference on Learning Representations 2026, evaluated 11 large language models across 18 structured output formats and 44 tasks. Even the best-performing proprietary systems reached only about 75 percent accuracy, while top open source models achieved close to 67 percent.

Structured output remains a critical weak point

The study, titled “StructEval: Benchmarking LLMs’ Capabilities to Generate Structural Outputs,” focused on formats commonly used in development pipelines, including JSON, YAML, CSV, HTML, React and SVG. These formats are essential for integrating AI-generated code into production systems.

Researchers assessed model outputs using a combination of syntax validation, keyword matching and visual question answering. The results showed that while models performed reasonably well on text-based tasks such as documentation and simple data structures, they struggled with more complex outputs.

Tasks involving visual or layout elements, including image generation, video content, dynamic web design and diagram code, produced the highest error rates. The study also found that generation tasks, where models convert natural language instructions into structured formats, were significantly more difficult than conversion tasks between existing formats.

Human oversight remains essential

The research team included Dongfu Jiang, Jialin Yang and Wenhu Chen, supported by a group of 17 contributors involved in annotation and evaluation. According to Jiang, the study measured both syntactic correctness and whether outputs meaningfully addressed the task.

He noted that despite rapid advances, AI coding systems still require close human supervision. Developers using these tools cannot rely solely on automated outputs, particularly in environments where precision is critical.

Chen emphasized the collaborative research model at Waterloo, where students contribute to and lead benchmarking efforts, reflecting a broader trend in AI development that combines experimentation with evaluation.

Widespread adoption meets practical limitations

The findings come at a time when AI-assisted coding tools have become deeply embedded in software engineering workflows. A recent survey by The Pragmatic Engineer indicates that 95 percent of respondents use AI tools at least weekly, and 75 percent rely on them for at least half of their engineering tasks.

Platforms such as GitHub Copilot, Claude Code and Cursor are now standard in many development environments. However, the Waterloo study highlights a key risk: errors in structured outputs may not always be immediately visible, increasing the likelihood of hidden bugs or configuration issues.

In complex systems, such issues can propagate and lead to broader failures, making validation and review processes more important than ever.

The study has been published in Transactions on Machine Learning Research and contributes to ongoing discussions about the role of large language models in production-grade software development.


  • Fajr
  • Sunrise
  • Dhuhr
  • Asr
  • Maghrib
  • Isha

Read more

This website, walaw.press, uses cookies to provide you with a good browsing experience and to continuously improve our services. By continuing to browse this site, you agree to the use of these cookies.