ETLRx(TM)
At the core of our proprietary product ETLRx are the best algorithms that provide valuable analytics to business clients. ETLRx provides all the benefits of big data cloud computing in a cost-effective package. It is a plug-and-play product that does all the analytics heavy lifting for you, from data processing, ETL to encryption, scrubbing and masking of sensitive business data, machine learning pattern recognition.
The need for a big data analytics product in the cloud
Big data analytics becomes necessary for any function where extremely large data sets must be evaluated to identify patterns and trends to make informed decisions or predict the outcome of certain events.
For instance, consider financial organizations and retail traders, who can extract a lot of useful information to assist them in their trading decisions. The New York Stock Exchange (NYSE) generates 1 terabyte of data everyday. The daily turnover in the equity cash segment of National Stock Exchange (NSE) is about $3 billion and half a billion dollars for the Bombay Stock Exchange (BSE). It is humanly impossible to interpret such a vast volume of data.
That’s why institutional investors and financial advising firms rely on analytics tools and expert teams to analyze terabytes of data to serve clients and internal needs effectively. The unstructured data cannot be fit into a pre-designed mathematical model, but the structured data can be handled through spreadsheets and relational databases. The role of analytics tools is to separate the non-actionable data and run the rest through algorithms.
What does ETLRx achieve?
- ETLRx uses the Aroon, Death Cross, Gold Cross, F-Score and Cape Ratio algorithms, in conjunction with analytical models to provide accurate predictions of stock behavior.
- It connects to the internal IT-CADDIE Hadoop server to process daily data – more than millions of records in less than 5 minutes – and performs analytics to provide answers to queries such as ‘what percentage of traders are saying the price will go up versus the percentage of traders who say it will fall’. ETLRx can process this report in less than 2GB memory.
- It is a web based big data analytical processing system, which decouples client server and database via VPN connection using cloud servers, which are cost effective and highly scalable.
- By using pattern recognition, an important branch of machine learning, ETLRx adds an aspect of Artificial Intelligence to aid smarter decision-making.
- As it is based on Hadoop, new data sources can be more easily accessed and different types of data can be tapped into for valuable insights. The excellent fault tolerance of Hadoop also ensures that a back-up copy is available in the event of failure.
Case Study Bull Trends Mobile App
The Bull Trends Mobile stock application is powered by ETLRx which is a cloud based big data product. It processes daily stock prices for the entire US market and India every 15 minutes. At end of day ETLRx performs computations / analytics using IT-CADDIE proprietary algorithms on data and provide trends of stocks to consumers every day.
We use the following algorithms for Bull Trends:
- Aroon
- Death Cross
- Gold Cross
- F-score
- Cape Ratio
Case Study CBOE HADOOP
ETLRx – Connects to Internal IT-CADDIE Hadoop server and perform the analytics on CBOE options trade data and it processed daily data (more than million records less than 5 mins) . Out of this we learned that for stocks what percentage of traders say go up vs what percentage of traders say go down. We are able to process this report less than 2GB Memory.
Why invest in ETLRx?
- It processes data on the cloud, which means no storage is required. This reduces the need for infrastructure, and cuts costs by 60%.
- It processes data on parallel threads/nodes, which is a lot faster than other products in the market.
- It is single-stop product for all your data processing needs, delivering an excellent return on your technology investment.
Cloud Based Big Data Analytics Solution
We decouple the processing of data from the database.
ETLRx Processing of data
High Level Architecture Hadoop and Relational
ETLRx Job Scheduler
