We use cookies, including third-party cookies from Google to serve personalized ads through AdSense, to operate this site and understand how it is used. By continuing to browse, you accept this use. See our Privacy Policy and Terms of Use for details, including how to opt out of personalized advertising.
Accept
SmartData CollectiveSmartData Collective
  • Analytics
    AnalyticsShow More
    chatgpt image jul 21, 2026, 04 34 30 pm
    4 Core Benefits of Predictive Maintenance after Vibration Analysis
    10 Min Read
    How Does Data Mining Boost Customer Satisfaction in Logistics? Harnessing Analytics for Results -- AI-generated illustration
    How Does Data Mining Boost Customer Satisfaction in Logistics? Harnessing Analytics for Results
    11 Min Read
    chatgpt image jul 13, 2026, 04 23 45 pm
    How Data Analytics Helps Companies Improve User Engagement
    19 Min Read
    chatgpt image jul 13, 2026, 03 59 46 pm
    How Data Analytics Improves Multi-Location Search Strategies
    10 Min Read
    cybersecurity efforts
    How Behavioral Analytics and AI Are Redefining Cybersecurity for Boca Raton Businesses
    14 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-25 SmartData Collective. All Rights Reserved.
Reading: Personal Data Mining: Solving a Mystery
Share
Notification
Font ResizerAa
SmartData CollectiveSmartData Collective
Font ResizerAa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Analytics > Personal Data Mining: Solving a Mystery
Analytics

Personal Data Mining: Solving a Mystery

ThemosKalafatis
ThemosKalafatis
6 Min Read
Personal Data Mining: Solving a Mystery
Illustration generated with FLUX.2 [klein 4B] via Cloudflare Workers AI.
SHARE
In a previous post I described the way that I captured a year’s worth of personal data using my smartphone with the purpose of identifying trends with my immune system, which at times gave me perennial conjunctivitis and also swollen lymph nodes. Now it is time to analyze all of this data in hopes that some useful knowledge can be found.
 
I had to make a decision about which tools to use.
In a previous post I described the way that I captured a year’s worth of personal data using my smartphone with the purpose of identifying trends with my immune system, which at times gave me perennial conjunctivitis and also swollen lymph nodes. Now it is time to analyze all of this data in hopes that some useful knowledge can be found.
 
I had to make a decision about which tools to use. I used WEKA and also decided to give KNIME a try, so here is an example of a KNIME workflow :
I first use the file reader to read my year’s worth of life data, then an R Script is used for several data transformations. I then send the streams of data first to an R Script, which runs the FSelector package to which several feature selection algorithms (about 10 of them) are applied to get an understanding of what are the important features for the problem at hand.
 
Then another stream sends the data to an R node, which creates dummy variables and then sends the transformed features to a linear correlation node for further inspection.

A third stream (not shown) sends the data to 3 machine-learning algorithms (namely an SVM, Decision Tree and Random Forest) and the Scorer shows how each algorithm performed.

I first executed the FSelector node using 10-fold cross-validation because I wanted to get a first feel of the features that are important in identifying some patterns about my perennial conjunctivitis.  7 out of 10 of  FSelector algorithms agreed that

1) Vitamin D3
2) Garlic
3) Yoghurt

appear to have the most predictive power. The problem is that at this point we do not know if any of the features actually help or aggravate my condition. However, the output of FSelector gives an idea as to which features should be looked at more closely.

Then the second stream was run, the one that sends the data to three machine-learning algorithms so that I could get a first feel of how the algorithms perform. All three algorithms gave an F-Score of around 59 – 62%.

By looking at the results some patterns appeared to arise (note the word “appeared”):

1) A rather large daily dose  (>5200 IU) of Vitamin D3 appears to be associated with smaller incidences of conjunctivitis.
2) Garlic consumption appears to increase my conjunctivitis incidences.
3) Yoghurt consumption appears to increase my conjunctivitis incidences.

For Pattern (1) we need to be aware that Vitamin D3 dosage has a compounding effect so it is rather naive to think that boolean logic applies (see previous post for more).

Next I had to look at patterns (2) and (3). One of the things that I realized when searching the web for the effect of various nutrients in functions of the human body is the fact that you can find for any several entries that sometimes contradict each other. My very brief web search has found garlic and yoghurt to be “immune boosters.” Of course caution should be exercised in drawing any conclusions because of the way the data have been collected and also the problematic origin of the analysis. Moreover, I am not a doctor and I cannot possibly know whether garlic or yoghurt can aggravate an immune response in such a way. 

 
I began taking Vitamin D3 and eliminating garlic and yoghurt from my diet. The result was that over a period of one month I stopped getting bouts of conjunctivitis and incidences of swollen lymph nodes. So has Vitamin D3 acted as an “immune response regulator” and garlic – yoghurt as “immune boosters”?

Although my bouts of conjunctivitis have ceased, I am not in any position to make any claims because there are a lot of uncontrolled variables:

– It could be a placebo effect.
– There may be unknown hidden variables that are important.
– Genetics.
– Environment.
– Variations in dosage and nutrient content.
– Interactions between nutrients.

There are lots of others that could not possibly be accounted for under these circumstances.

What I can say (and this is the reason for writing this post) is that analytics may help us to identify several patterns that may then be used to guide a sound knowledge discovery process. If people had the ability to collect data on a daily basis (see Quantified Self) and then analyze them on a massive scale, several unknown patterns that call for closer investigation could emerge.

TAGGED:data analysisdata miningknimer languageunstructured dataweka
Share This Article
Facebook Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

Illustration of mobile analytics dashboards with ad performance charts connected to backend databases
11 Best Sisense Alternatives for Embedded Analytics
Business Intelligence Exclusive
Analyst points at colorful circular data dashboard on screen - information technology business metrics
How Fragmented Workplace Tech Undermines Reliable Business Metrics and Reporting
Cloud Computing Exclusive Infographic IT
Using Multi-Source Data and Analytics to Detect Operational Drift Across Franchise Networks -- AI-generated illustration
Using Multi-Source Data and Analytics to Detect Operational Drift Across Franchise Networks
Exclusive Infographic
Beyond The First Impression: The Long-Lasting Impact Of Sensory Marketing -- AI-generated illustration
Beyond The First Impression: The Long-Lasting Impact Of Sensory Marketing
Infographic Marketing

Stay Connected

1.2KFollowersLike
33.7KFollowersFollow
222FollowersPin

You Might also Like

The three legged stool - business, analytics, IT
Data MiningExclusivePredictive Analytics

The three legged stool – business, analytics, IT

6 Min Read
Data Visualization Best Practices for Business Intelligence
AnalyticsBest PracticesBusiness IntelligenceData VisualizationExclusive

Data Visualization Best Practices for Business Intelligence

9 Min Read
A Quick Guide to Structured and Unstructured Data
AnalyticsBig DataData ManagementData MiningHadoopMapReduceMarketingSocial DataStatisticsUnstructured DataWeb Analytics

A Quick Guide to Structured and Unstructured Data

7 Min Read
Social Data on Chinese Microblogs and the Oscars
AnalyticsData MiningData VisualizationNewsSocial Media AnalyticsWeb Analytics

Social Data on Chinese Microblogs and the Oscars

3 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

From Bolts to Bots: How AI Is Fortifying the Automotive Industry
From Bolts to Bots: How AI Is Fortifying the Automotive Industry
Artificial Intelligence
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence for eCommerce: A Closer Look
Artificial Intelligence

Quick Link

  • About
  • Contact
  • Privacy
Follow US
© 2008-26 SmartData Collective. All Rights Reserved.
Welcome Back!

Sign in to your account

Username or Email Address
Password

Lost your password?