Arush Arush Kharbanda
Arush was a technical team member at Sigmoid. He was involved in multiple projects including building data pipelines and real time processing frameworks.
Arush Kharbanda
He was a technical team member at Sigmoid.
Implementing a Real-Time Multi- dimensional Dashboard

The Problem Statement
An analytics dashboard must be capable enough to highlight to its users areas needing their attention. This Rolex Replica needs to be done in real time and displayed within acceptable display time lag to the user. Any screen must be displayed within industry standard time of 3 sec’s. You would need to grill your data along a large number of dimensions. You can make your data talk if you can grill it along the right dimensions (time, location, site, access device ).
2-sigview
[Fig 1-Multi dimensional drill down dashboard]
The screenshot shows SigView Dashboard, it shows the drilldown for Coca Cola Ads in USA with people viewing the ad from a Laptop  using OS X.
The transaction and log data being generated in a current systems in humongous. You might want to grill your data along 100’s of dimensions. But for a dashboard to support 5 dimensional drill down along 100 dimensions mean (100C5 = (100*99*98*97*96*95)/(5*4*3*2)) possible rollups. This means that it’s impossible to compute all pre roll ups. omega seamaster 300m replica

The Solution
To solve this problem, SigView uses a hybrid approach. Storing data in columnar format, computing pre roll ups on all dimensions but only up to a certain point and then resorting to use the raw data when more you try to grill down on more dimensions. Columnar storage along with low cardinality allows for very high compression. The dashboard considers time as a filter, with hour, day and week level of granularity. The dashboard is powered by Apache Spark and can display any result in less than 2 sec’s for up to 60 GB’s of data processed per minute.

Recommended for you

The Quantum Supremacy Experiment

January 28th, 2020|

Aniruddh Rawat Aniruddh Rawat is a Data Scientist at Sigmoid. He works with data and application of Machine Learning algorithms. Currently he is focusing on Quantum Machine Learning, Recommendation Systems Aniruddh Rawat Aniruddh is a Data Scientist at Sigmoid. The Quantum Supremacy Experiment Introduction As a continuation of our previous blog about Quantum Computing and Quantum Supremacy, we have tried to explain the what, why and how of the experiment performed by Google as mentioned in this paper in

What’s all the fuss about Quantum Computing and Quantum Supremacy?

January 16th, 2020|

Aniruddh Rawat Aniruddh Rawat is a Data Scientist at Sigmoid. He works with data and application of Machine Learning algorithms. Currently he is focusing on Quantum Machine Learning, Recommendation Systems Aniruddh Rawat Aniruddh is a Data Scientist at Sigmoid. What’s all the fuss about Quantum Computing and Quantum Supremacy? Introduction “Quantum Computers will soon outperform Classical Machines” The internet has been flooded with such sentences in the past few days mentioning that in the near future, quantum computers can

Reinforcement Learning – Applications and Challenges

December 13th, 2019|

Abhijeet Mittal Abhijeet is a Data Scientist at Sigmoid. He mainly works in the domain of Recommendation Engines, Time Series Forecasting, Reinforcement Learning and Computer Vision. Abhijeet Mittal Abhijeet is a Data Scientist at Sigmoid. Reinforcement Learning – Applications and Challenges In the last blog we covered the basics of Reinforcement Learning (RL), its common rules and its terminologies. In this edition, we will focus on its real-world applications, challenges associated and its relevance in the world of Data

By |2019-10-22T10:17:32+00:00July 13th, 2015|Shark, Streaming, Technology|