Cookies help us display personalized product recommendations and ensure you have great shopping experience.

By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    data analytics and truck accident claims
    How Data Analytics Reduces Truck Accidents and Speeds Up Claims
    7 Min Read
    predictive analytics for interior designers
    Interior Designers Boost Profits with Predictive Analytics
    8 Min Read
    image fx (67)
    Improving LinkedIn Ad Strategies with Data Analytics
    9 Min Read
    big data and remote work
    Data Helps Speech-Language Pathologists Deliver Better Results
    6 Min Read
    data driven insights
    How Data-Driven Insights Are Addressing Gaps in Patient Communication and Equity
    8 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Stat Models, Astronomical Mysteries…and Business Data
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Analytics > Stat Models, Astronomical Mysteries…and Business Data
AnalyticsBig DataBusiness IntelligenceStatistics

Stat Models, Astronomical Mysteries…and Business Data

vincentg64
vincentg64
4 Min Read
SHARE

If you look at the picture below (Pleiades constellation), you will see – with the naked eye – that many star systems appear to be binary: that is, involving two (or more) stars orbiting around each other.

If you look at the picture below (Pleiades constellation), you will see – with the naked eye – that many star systems appear to be binary: that is, involving two (or more) stars orbiting around each other.

Is this a coincidence, or can we prove that from a statistical point of view, based on the theory of stochastic point processes, we are NOT dealing with a pure random process (Poisson process)? At first glance, as a statistician, I would say that the chance of observing so many pairs is extremely low, far below 0.000000001%. Now keep in mind that 2 stars that look very close to each other when viewed from Earth might actually be much more distant from each other than 2 stars that seem far apart, because we lack depth (the third dimension, or perspective) in these pictures. Also, most binary systems apparently consist of a normal star and a much smaller companion, thus we might see only a small fraction of all binary systems. In other words, maybe 90% of all solar systems are binary. Finally, there are cloudy areas in the picture below, where gas clouds hide stars located behind them.

The way to compute the probability to observe so many binary systems is as follows: 

More Read

asp.net and big data age
The Overlooked Benefits Of ASP.Net In Big Data Analytics
How Big Data Analytics & AI Combined can Boost Performance Immensely
Top ten RRReasons R is bad for you ?
10 Effective Big Data Strategies For Marketing Online
Is Sentiment Analysis a Subset of Text Analytics?
  • Simulate one million realizations of a Poisson process on a rectangle (the size of the picture below), each with 300 points (I’m assuming there are about 300 relatively bright stars in the picture below; let’s ignore the dim stars as they are just adding noise).
  • Compute the number of stars where closest neighbor is less than 1.5 millimeter away, for each of the one million simulations. Average your computations.
  • If that average number is below x=5 as I would guess (or even if it is below x=20 for that matter), then clearly the Poisson assumption is violated since we observe at least x=50 bright binary stars in the picture, so we really are dealing with a star generation mechanism that favors binary over single stars.

Note that if you know elementary statistics and basic concepts about Poisson processes (the most basic of all stochastic processes), then you don’t even need to perform one million simulations. There is an exact mathematical formula that tells you the expected number of binary starts that you should see if binary stars were not favored: it is based on the Erlang distribution. Distances to nearest neighbors have extensively been studied in statistics; there is a solid theoretical background around it.

stat models business data

On a different topic, can we apply statistical principles used in astronomy, in the business world of big data?

I’m thinking of a measuring distance to far away stars as an example, where multiple measurements from a highly calibrated system are aggregated to refine the accuracy. In some ways, using multiple measurements to amplify a very weak signal. Can this concept of signal amplification be used to gain better, more accurate insights from big data? After all, business data is also very noisy and foggy: it also has its own clouds just as in the above picture, both metaphorically and physically, making statistical inference, pattern detection, and insights discoveries more difficult. 

Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

data analytics and truck accident claims
How Data Analytics Reduces Truck Accidents and Speeds Up Claims
Analytics Big Data Exclusive
predictive analytics for interior designers
Interior Designers Boost Profits with Predictive Analytics
Analytics Exclusive Predictive Analytics
big data and cybercrime
Stopping Lateral Movement in a Data-Heavy, Edge-First World
Big Data Exclusive
AI and data mining
What the Rise of AI Web Scrapers Means for Data Teams
Artificial Intelligence Big Data Exclusive

Stay Connected

1.2kFollowersLike
33.7kFollowersFollow
222FollowersPin

You Might also Like

freight data
Big DataExclusive

Big Data Is Crucial For Freight Operator Safety During COVID-19

7 Min Read
ai in branding
Artificial Intelligence

AI-Driven Customization Provides Tremendous Benefits for Your Brand

7 Min Read
protect your data from your ISP
Best PracticesBig DataData ManagementExclusiveGDPRITPolicy and GovernancePrivacySecurity

Try These Tips On How To Protect Your Data From Your ISP

8 Min Read
Image
Big Data

Kayak Uses Big Data to Predict the Best Day to Book Your Travel Journey

5 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

ai chatbot
The Art of Conversation: Enhancing Chatbots with Advanced AI Prompts
Chatbots
AI and chatbots
Chatbots and SEO: How Can Chatbots Improve Your SEO Ranking?
Artificial Intelligence Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-25 SmartData Collective. All Rights Reserved.
Go to mobile version
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?