Quantum computing has become a major threat to most classical cryptosystems, especially RSA and ECC cryptosystems. Thus, a new field, Post-Quantum Cryptography (PQC), has come to light, aiming to create protocols that cannot be susceptible to quantum attacks. This work presents a new Boolean Semiring Key Exchange Protocol combined with BLAKE3 cryptographic hash function (BKEX-B3). The protocol leverages the flexibility of BLAKE3’s eXtendable Output Function (XOF) and the nonlinearity of Boolean algebra to produce a flexible, quantum-resistant solution capable of dynamically adapting security levels to advancement in quantum algorithms. An examination of the protocol’s performance reveals that it outperforms modern algorithms, especially in terms of memory efficiency and runtime, such as Kyber512, HQC-128, BIKE-L1, sntrup761, FrodoKEM-640-SHAKE, and NewHope. Its scalability and efficient resource management make it a highly appropriate solution that is adaptable and secure for the post-quantum era in environments with limited resources, such as the Internet of Things.

Machine learning techniques like Self Organizing Maps has been explored for the first time for efficient key clustering in cryptanalysis. In the first phase, transformations have been employed on the encrypted messages to find the dominance in the features and n, in the second phase, Independent Component Analysis -ICA to find important features among the transformed features and finally SOM has been employed for clustering.