ANALYSIS OF SCIENTIFIC TEXTS BASED ON LANGUAGE MODELS BY DISTRIBUTED PROCESSING ALGORITHMS

The paper analyzes the problems associated with processing large amounts of text data, such as scientific articles, and discusses the possibilities of using distributed data processing systems to improve the efficiency of analysis. In particular, the authors of the paper study the use of language models such as -grams and recurrent neural networks to extract meaning and classify scientific texts. The paper presents algorithmic approaches and methods based on distributed processing and describes the possibilities of using language models and distributed processing algorithms. In general, a new approach to the analysis of scientific texts is proposed, based on the use of language models and distributed data processing frameworks.