article thumbnail

Benchmarks without context are meaningless: The pitfalls of data without insight

CIO

This is a common scenario: A client reaches for benchmarks and metrics without fully grasping the larger context. But benchmarks, while useful in certain cases, are often misleading when taken out of context. Executives and boards want hard data, and benchmarks offer an easy way to provide seemingly objective metrics.

article thumbnail

Salesforce debuts gen AI benchmark for CRM

CIO

Salesforce today announced a first-of-its-kind gen AI benchmark for CRM, which aims to help businesses make more informed decisions when choosing large language models (LLMs) for use with business applications. Enter the new gen AI benchmark. He adds that this is only the first iteration of the benchmark.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Top 8 failings in delivering value with generative AI and how to overcome them

CIO

Learn more about IDC’s research for technology leaders OR subscribe today to receive industry-leading research directly to your inbox. Daniel Saroff is group vice president of consulting and research at IDC, where he is a senior practitioner in the end-user consulting practice. Contact us today to learn more.

article thumbnail

Google claims quantum leap with new Willow chip

CIO

Second, Willow can perform a standard benchmark calculation in less than five minutes. Better error correction To calculate performance, Google used the Random Circuit Sampling (RCS) benchmark. RCS was developed in-house by the Quantum AI Lab and is widely used in the field of quantum computing.

article thumbnail

Can Businesses Meet Increasing Consumer Expectations?

According to 3BL and TriplePundit’s Consumer Insights & Sustainability Benchmark two-thirds of U.S. This research reveals what issues consumers care about and how businesses can tailor their communications to different segments of consumers. adults actively seek and follow sustainability issues.

article thumbnail

LatticeFlow launches first comprehensive evaluation framework for compliance with the EU AI Act

CIO

Although it identifies six ethical principles, these haven’t been translated into codified benchmarks, and there have yet to be any concrete standards or recommendations issued. Researchers point out that the act is expected to have an impact beyond EU borders due to its “wide extraterritorial effects.” for the latter).

article thumbnail

4 key AI risks to address when contracting services or products

CIO

CIOs and organizations recognizing this risk (and following recommendations of research firms) are now embedding specific requirements in their vendor and partner contracts. Learn more about IDCs research for technology leaders OR subscribe today to receive industry-leading research directly to your inbox.

article thumbnail

Understanding User Needs and Satisfying Them

Speaker: Scott Sehlhorst

In this webinar, we won't focus on the research methods for discovering user-needs. The obvious challenge is figuring out what our users need; the non-obvious challenges are in creating a shared understanding of those needs and in sensing if what we're doing is meeting those needs.