Showing posts with label risk management. Show all posts
Showing posts with label risk management. Show all posts

Thursday, March 7, 2024

Introducing CopyrightCatcher, the first Copyright Detection API for LLMs; Patronus AI, March 6, 2024

 Patronus AI; Introducing CopyrightCatcher, thefirst Copyright Detection API for LLMs

"Managing risks from unintended copyright infringement in LLM outputs should be a central focus for companies deploying LLMs in production.

  • On an adversarial copyright test designed by Patronus AI researchers, we found that state-of-the-art LLMs generate copyrighted content at an alarmingly high rate 😱
  • OpenAI’s GPT-4 produced copyrighted content on 44% of the prompts.
  • Mistral’s Mixtral-8x7B-Instruct-v0.1 produced copyrighted content on 22% of the prompts.
  • Anthropic’s Claude-2.1 produced copyrighted content on 8% of the prompts.
  • Meta’s Llama-2-70b-chat produced copyrighted content on 10% of the prompts.
  • Check out CopyrightCatcher, our solution to detect potential copyright violations in LLMs. Here’s the public demo, with open source model inference powered by Databricks Foundation Model APIs. 🔥

LLM training data often contains copyrighted works, and it is pretty easy to get an LLM to generate exact reproductions from these texts1. It is critical to catch these reproductions, since they pose significant legal and reputational risks for companies that build and use LLMs in production systems2. OpenAI, Anthropic, and Microsoft have all faced copyright lawsuits on LLM generations from authors3, music publishers4, and more recently, the New York Times5.

To check whether LLMs respond to your prompts with copyrighted text, you can use CopyrightCatcher. It detects when LLMs generate exact reproductions of content from text sources like books, and highlights any copyrighted text in LLM outputs. Check out our public CopyrightCatcher demo here!

Friday, December 29, 2023

Testing Ethical Boundaries. The New York Times Sues Microsoft And OpenAI On Copyright Concerns; Forbes, December 29, 2023

 Cindy Gordon, Forbes; Testing Ethical Boundaries. The New York Times Sues Microsoft And OpenAI On Copyright Concerns

"We have at least seen Apple announce an ethical approach to discussing upfront with the US Media giants their interest in partnering on AI generative AI training needs and finding new revenue sharing models.

Smart Move by Apple...

The court’s rulings here will be critical to advance ethical AI practices and guard rails on what is “fair” versus predatory.

We have too many leadership behaviors that encroach on others Intellectual Property (IP) and try to mask or muddy the authenticity of communication and sources of origination of ideas and content.

I for one will be following these cases closely and this also sends a wake -up call to all technology titans, and technology industry leaders that respect, integrity and transparency on operating practices need an ethical overhauling.

One of the important leadership behaviors is risk management and looking at all stakeholder views and appreciating the risks that can be incurred. I am keen to see how Apple approaches these dynamics to build a stronger ethical brand profile."

Friday, January 4, 2019

Ethics Webinar: When an Attorney or Expert Screws Up; American Bar Association (ABA), Thursday, January 24, 2019


 
American Bar Association.
 
 
 
 
 
 
Webinar-image
 
 
 
LEARN MORE
 
 

Sunday, August 5, 2018

Convercent CEO: Encourage Employees to Speak Up on Ethics Issues; Fortune, August 1, 2018

Damanick Dantes, Fortune; Convercent CEO: Encourage Employees to Speak Up on Ethics Issues

"The risk of an ethics scandal is far too great for a CEO to ignore. The conventional approach is to publish a list of ethics guidelines and expect everyone in an organization to follow—but if there’s one thing we’ve learned this year, it’s simply not enough. At risk: the image of an organization and the finances of its stakeholders.

Call it the post-Harvey Weinstein era. The court of public opinion holds corporations accountable for saying one thing and doing another, says Patrick Quinlan, CEO of compliance management software company Convercent. Quinlan’s company operates a compliance and ethics cloud platform—think of it as a 21st century whistleblower hotline—for employees of businesses and governments around the world."