Skip to content

The captivating AROM of distributed processing

Last month we have had the opportunity to present AROM at the 4th IEEE International Conference on Cloud Computing Technology and Science (CLOUDCOM) in Taipei, the beautiful capital of Taiwan. For the people who are just getting on train, I will quickly here recall what AROM is about, where one can find it and how its taste is.

AROM is a distributed processing framework which aims at providing a playground for research on distributed processing. Its main objective is to provide a convenient environment for quickly implementing and prototyping on distributed algorithms and jobs. This is achieved first by the DataFlow Graph processing model, where jobs are expressed as Directed Acyclic Graphs expresing operations and the dependencies of the data.  By remaining simple and general, this processing model allows for greater flexibility and optimization. Furthermore, the fact that it is written entirely using Scala and the Akka Actors framework ensures for scalability, and the reusing of paradigms borrowed from the functional programming world (such as higher order, anonymous constructs, …)  enforces reusability and genericity of the job implementations.

Oh, and did I tell you that it is fully released in open source?

References

– N.-L. TRAN, S. SKHIRI, A. LESUISSE, E. ZIMANYI, AROM: Processing Big Data with DataFlow Graphs and Functional Programming. Proceedings of the International Workshop on Cloud Computing for Research Collaborations. 4th IEEE International Conference on Cloud Computing Technology and Science (CLOUDCOM): http://code.ulb.ac.be/dbfiles/TraSkhZimLes2012incollection.pdf

–  AROM distributed processing: http://arom-processing.org/

– AROM on GitHub: https://github.com/nltran/arom


 

Releated Posts

Evaluation of GraphRAG Strategies for Efficient Information Retrieval

Traditional RAG systems struggle to capture relationships and cross-references between different sources unless explicitly mentioned. This challenge is common in real-world scenarios, where information is often distributed and interlinked, making graphs a more effective representation. Our work provides a technical contribution through a comparative evaluation of retrieval strategies within GraphRAG, focusing on context relevance rather than abstract metrics. We aim to offer practitioners actionable insights into the retrieval component of the GraphRAG pipeline.
Read More

Flight Load Factor Predictions based on Analysis of Ticket Prices and other Factors

The ability to forecast traffic and to size the operation accordingly is a determining factor, for airports. However, to realise its full potential, it needs to be considered as part of a holistic approach, closely linked to airport planning and operations. To ensure airport resources are used efficiently, accurate information about passenger numbers and their effects on the operation is essential. Therefore, this study explores machine learning capabilities enabling predictions of aircraft load factors.
Read More