Edgeless Systems debuts its latest offering, a cutting-edge confidential AI service, aimed at fortifying the generative AI market
Cybersecurity firm Edgeless Systems has unveiled its latest security innovation, Continuum, marking a significant milestone in enabling cloud-based “confidential AI” services for the first time.
Addressing the pervasive concern among businesses regarding the use of AI services with sensitive data due to potential data breaches, Continuum ensures that user requests and corresponding replies remain encrypted throughout their interaction within an AI service.
One of Continuum’s key features is its ability to render plaintext data inaccessible to both the AI service provider and the underlying cloud infrastructure, safeguarding the valuable weights of AI models in the process.
Felix Schuster, CEO of Edgeless Systems, asserts, “Continuum will significantly impact the generative AI market, empowering a broader spectrum of enterprises, particularly those in regulated sectors, to confidently embrace offerings like chatbots.”
He adds, “This product epitomizes our commitment to enabling the utilization of cloud services without compromising on data security or compliance.”
Powered by the computational prowess of Nvidia H100 GPUs, coupled with advanced cryptographic techniques and sandboxing technology, Continuum not only prioritizes end-user security but also equips AI service providers with the capability to update models and code without compromising security.
Moreover, Continuum extends protection to AI models and intellectual property, ensuring comprehensive security throughout the AI lifecycle.
The solution seamlessly integrates with large language models (LLMs) such as Mistral 7B and supports popular AI serving frameworks like Nvidia Triton Inference Server and vLLM.
Edgeless Systems, based in Germany, recently secured $5.3 million in seed round funding, led by SquareOne. This financial injection followed the company’s announcement of the general availability of its Constellation platform, accessible through the GitHub repository.
As a provider of open-source software for confidential computing, Edgeless Systems offers the EGo toolkit for developing cloud-native applications. Furthermore, the company actively participates in the Confidential Computing Consortium, alongside industry giants like Microsoft, Google, Red Hat, Intel, and Huawei, demonstrating its commitment to advancing secure computing practices on a global scale.
