Corem

Refining mineral extraction with real-time data

Exterior aerial view of a mine site with smoke

The context

Corem, a non-profit center for expertise and innovation based in Quebec, offers a comprehensive suite of research services to mining corporations, designed to enhance operational efficiencies and optimize processing. Recently, one of their clients—a mining company renowned for producing critical alloying agents—required an analytical model to refine their extraction process of fused minerals.

The procedure begins with melting various minerals together in a large oven, subsequently cooling the fused minerals on a plate, and analyzing the resulting changes in temperature, shape, and colour. Previously, these tasks were performed manually by Corem's client, leading to numerous defects. The new process would be monitored via video stream, with Corem’s sophisticated algorithm determining the varying proportions of materials within the compound.

The project aimed to analyze and present detailed data on material concentration and the cooling effects within these materials. Corem partnered with us to design and develop a web dashboard that would effectively gather and display this crucial data. Here are the details of the project.

Project details

Industry

Mining

Technologies

Python

Docker

Mongo DB

Influx DB

Web components

Services

Development

The challenge

We were tasked with developing a custom interface that collects data from Corem’s algorithm, presenting it in both graphical and tabular formats. This interface would also enable the export of data into a formatted CSV file for further use. The graph developed allows the user to pin point data directly on the graph in order to extract specific data for comparative analysis.

Navigating the technical landscape of this project presented a challenge, primarily due to the deployment of all systems on Corem’s private server. Their setup was a virtual machine running Windows, and it wasn’t linked to any network. With no cloud access, the server's capacity limitations meant we couldn't just push large amounts of data across—every byte had to be meticulously managed.

To bridge these gaps, our team embraced a creative, solution-driven approach. We encountered and tackled issues reminiscent of those found in the Internet of Things (IoT) sphere, such as blocked IP addresses, which required clever workarounds to ensure connectivity between the application and components like cameras and databases. Additionally, the project required the integration of two distinct databases, MongoDB and InfluxDB, each with its own protocol and communication challenges. Extracting and effectively redistributing data from these diverse systems to the front end demanded careful coordination and a deep understanding of both databases, ensuring that Corem’s client could rely on a seamless flow of information.

People brainstorming in a meeting with a white board

The task at hand

Over ten weeks, we provided Corem's client with an MVP version of the platform to ensure a quick return on investment. We conducted workshops to model the solution, which included wireframing and questioning each entity involved. This process allowed us to establish clear connections between the data sets. From there, we enhanced the platform by incorporating additional KPIs and subsequently developed the solution further.

For the technical core of the project, we selected a robust suite of technologies to maximize longevity and efficiency. On the back-end, we utilized Python with Docker for containerization, streamlining development and enhancing scalability by encapsulating services into secure, manageable units. Targeted scripts were employed for specific tasks. For the front-end, we chose Javascript and web components to future-proof the dashboard, opting for a more stable solution over transient frameworks like React, ensuring relevance and operability for the next two decades. This aligns with our commitment to delivering sustainable, forward-thinking digital solutions.

Additionally, we implemented a microservices architecture, which significantly reduced memory usage and enhanced dashboard performance. This design supports detailed service management essential for the project's complex data interactions. These technological choices created a dynamic, resilient web platform for the mining company, ensuring the dashboard meets current needs and adapts to future demands.

The end result

The software is now in production being used by mine personnel upwards of 15 times a day with an objective to streamline data analysis and drastically reduce the time spent in critical mining zones. By integrating video streaming and camera technology, the system allows for real-time monitoring and analysis, which minimizes defects and boosts operational reliability. The project's success has garnered high satisfaction from both Corem and their client. And, thanks to the continuous video tracking and real-time analysis, issues can now be promptly addressed, maintaining the availability of accurate data throughout the process.

What’s next

We love sinking our teeth into the development of tailored, cutting-edge solutions that address unique sector challenges. With this new mining platform now live, we continue to evolve the software, responding to Corem and their client’s requests for additional functionalities, such as enhanced data recording within the graphical interface. Our ongoing collaboration focuses on overcoming technical challenges and further refining the tool to meet the mining industry's specific demands.