Microsoft specialists have developed the B1.58 2B4T language model, which, with compact size, demonstrates results near larger analogues. The most important characteristic is the possibility to work on normal CPU, without the use of graphic gears. This opens access to AI technologies for a disability.
Instead of standard 16 or 32-bit calculations, the model uses simplified 1-bit with three conditions: -1, 0 and +1. This approach reduces the volume of the occupied memory to 400 MB – for comparison the nearest competitor from Google (Gemma 3 1B) requires 1.4 GB. The savings are achieved due to a fundamentally different approach to data processing: instead of complex mathematical operations, the system is based on optimized binary algorithms.
During the tests, Bitnet was compared with Meta (Llama 3.2 1B), Google (Gemma 3 1B) and Alibaba (Qwen 2.5 1.5b). Despite the smaller “weight”, the development of Microsoft showed the average result of 54.19 points in complex tests, whereby Lama (44.90) and Gemma (43.74) (43.74) were bypassed, and only a little transmission to Qwen (55.23), which occupies 6.5 times more memory. Bitnet took a leading position in certain tasks with regard to the analysis of the text.
For maximum efficiency, the model requires a special Framework Bitnet.cpp, available in the Github Open Repository. Standard tools such as the Transformers Library do not fully reveal the potential. The developers note that the current version is aimed at CPU, but in the future they will add support for neuroprocessors and GPU.
Bitnet is an example of the tendency to “illuminate” AI models. Such solutions reduce energy consumption and enables you to perform complex algorithms on devices without access to cloud services. This applies in particular to regions with a slow internet or when working with confidential data where the transfer of information to the data centers is undesirable. According to the authors, their goal is to make AI technologies available without an upgrade of iron, which can change the approach to the development of applications with artificial intelligence.
❄️ Barotrauma developers announced the Coop-Zhivach on the train frostrail
Source: VG Times
Gregory Robert is a sports aficionado and a writer for “Social Bites”. He provides in-depth coverage of the latest sporting events and trends, offering a unique and knowledgeable perspective on the world of sports.