Enhancing End-to-End Communication Security in Apache Kafka Using the SSS Algorithm
Kafka plays a strong role in the current real-time data streaming services which acts as a backbone for managing considerably vast amounts of data across diverse applications and systems. Despite the adeptness at handling high volumes of data and the strong architecture it can be seen that Kafka faces strong security challenges relating to transmission of data from one endpoint to another. Although the current security measures are substantial, they do fall short in dealing with emerging threats that ultimately leads to unauthorized access or the compromise of critical data.
In this thesis, we address the critical need for enhanced end-to-end security in Apache Kafka communications by proposing the integration of Shamir’s Secret Sharing (SSS) algorithm—a well-established cryptographic method for distributing sensitive information among multiple parties.