Data Science

|
13 min read
|
141 views
All of the main AI products that you’ve used during this week were created, tested, and debugged by a data scientist, not by the AI. This job is not going away. It is increasing in importance. This hub provides all kinds of resources from basic Python to deploying large language models. Choose your journey and dive in below.

Between 2023 and 2026, this field saw change that surpassed the last five years by leaps and bounds. The rise of generative AI did not do away with data scientists but rather altered how they allocate their efforts. Manual data cleaning — faster than ever. Creation of machine learning frameworks — heavily augmented by automation. But that which cannot be automated: discernment: figuring out what question to ask, identifying errors in predictions, and communicating insights in business terms.

This expertise has become increasingly valuable. Positions demanding skills in data science increased significantly until at least 2025 and showed no signs of reversal. Data scientists in mid-tier positions earned an average salary somewhere between $110k and $150k annually across different sectors in the United States. And the learning process could not have been easier — nearly all materials referenced in this guide are free.

What Is Data Science?

Data science is the practice of deriving decisions from data through statistics, coding, and subject matter expertise. Sounds straightforward enough on its face. However, confusion with the vocabulary gets in everyone’s way, so let’s clarify that first and foremost.

Data Science vs Data Analytics vs Machine Learning vs AI

Data Analytics is retrospective. You retrieve data, create queries, generate dashboards, and respond to questions such as “What led to the fall in Q3 revenues?” The tools you use are primarily SQL, Excel, Power BI, and Tableau.

Data Science is prospective. You develop models that draw lessons from past trends to make predictions about future outcomes. Data science builds upon an analytics base through adding skills in Python programming, statistics, and machine learning.

Machine Learning is a technique used within data science, which involves creating programs that learn from experience without being explicitly programmed by humans.

Artificial Intelligence is the ultimate objective – machines performing tasks previously reserved for human cognition. Machine learning is one of the key techniques for developing AI, while data science is the field of designing, training, and testing the resulting systems.

The Simple Framing

Analytics asks: what happened? Data science asks: what will happen? ML is the engine. AI is the destination.

Choose Your Learning Path

We don’t all have the same starting point. A biologist turning his hand to data science requires a totally different approach compared to a computer scientist or someone working in marketing and already fluent in Excel.

Path A

Complete Beginner

No coding, no stats background. Start from zero and build every skill in order.

Python → SQL → Stats →
Preprocessing → EDA →
Visualization → ML →
Projects → Careers
12–18 months at 10–15 hrs/week
Path C

Already in Data

Working analyst or engineer who needs to add ML or GenAI skills specifically.

ML → Deep Learning →
Generative AI & LLMs →
MLOps
2–4 months

One Honest Note: most tutorials dramatically underestimate how long this takes. The timelines above assume consistent, focused effort — not casual browsing. If you’re doing 3 hours a week, triple them.

The Data Science Landscape in 2026

The pace of change with respect to tooling was faster between 2023 and 2026 compared to the last five years. This is not an exaggeration; this is based on real job postings and the tools used by real data scientists.

The Modern Data Science Stack (2026 vs 2022)

2022 Stack

Python + Pandas + NumPy
Scikit-learn for ML
PyTorch / TensorFlow for DL
SQL for data extraction
Tableau / Power BI for viz
Jupyter Notebook for exploration
Airflow for pipelines

2026 Stack — Added Layer

LangChain / LlamaIndex for LLM pipelines
Hugging Face for model access
Pinecone / Chroma / FAISS — vector DBs
Claude / Copilot / Cursor — AI coding
MLflow / W&B for experiment tracking
dbt for data transformation
Databricks growing fast in enterprise

And yet, surprisingly, the basic requirements remained the same – knowledge of Python, SQL, and statistics was and will remain more important than proficiency with any particular tool. The difference lies in an additional layer built atop these fundamentals. Data scientists who aren’t able to work with LLMs are beginning to realize that.

Getting Started — Prerequisites & Setup

1. Do You Need a Math Background?

Not really. However, there are certain math skills you should have. Those include basic probability theory, descriptive and inferential statistics, linear algebra notions such as vectors and matrices (no proof required), and intuition regarding gradient descent algorithm. These account for about 80 percent of math skills you’ll be using. No theorems are required here; only the intuition behind a certain process is needed.

2. Python vs R

Sure, R is great for statistics, and it’s still popular among academics and in some drug companies. But if you want to get hired, learn Python. About 75-80% of jobs in data science require Python: machine learning libraries, AI platforms, pipelines – they all come first from Python. Learn Python. And then you can learn R, because it only takes about two weeks.

3. Setting Up Your Environment

Three options in order of ease:

Google Colab — zero setup, free GPU access
VS Code + Python extension

4. Realistic Timeline

Most answers to this question are either wildly hopeful or useless vague. Here’s a specific breakdown — assuming roughly 10–15 hours of consistent effort per week:

Starting Point To First DS Role To Senior Level
No coding background14–20 months4–6 years
Know Python basics8–12 months3–5 years
Already in analytics5–9 months2–4 years
CS / engineering background4–7 months2–3 years

These aren’t guarantees — they’re honest estimates based on what the job market actually requires, not what a course sales page wants you to believe.

Core Data Science Skills

Python for Data Science

Beginner

Python is the language of data science. Not because it’s the fastest or the most elegant — it honestly isn’t — but because the ecosystem built around it is unmatched. Every library you need exists. Every tutorial uses it. Every job listing asks for it. That network effect makes a tool dominant for a long time.

Python Fundamentals Beginner
⌛ 2–4 weeks
Python Introduction Install Python 3 Variables & Data Types Operators Conditional Statements Loops Functions Strings & Lists Dictionaries
NumPy — Numerical Computing Beginner
⌛ 1 week
NumPy Introduction Arrays & Operations Broadcasting Indexing & Slicing
Pandas — Data Manipulation Beginner
⌛ 2–3 weeks
Pandas Introduction DataFrames & Series GroupBy Operations Handling Missing Values Merging & Joining

SQL for Data Science

Beginner → Intermediate

Most beginners treat SQL as optional. It isn’t. In practice, the majority of data a scientist works with lives in a database. Before you model it, visualize it, or analyze it, you have to get it out. Strong SQL skills will often get you further in an early data science career than another month of ML theory — because the actual blocking point is usually data access, not model sophistication.

SQL Topics
SQL Introduction Installing MySQL / PostgreSQL CREATE DATABASE Queries & Filters Aggregate Functions Joins Subqueries Window Functions ⭐ Date & Time Functions Data Cleaning in SQL Indexes & Query Optimization

Mathematics & Statistics for Data Science

Beginner → Intermediate

Here’s the thing most courses won’t admit: you don’t need to be a mathematician. You need to be statistically literate. A mathematician proves theorems. A statistically literate data scientist knows when a p-value is being misused, why correlation isn’t causation, and what a confidence interval actually means in practice. That’s the bar.

Probability
Basic Probability Conditional Probability Bayes’ Theorem Probability Distributions
Linear Algebra & Calculus
Vectors & Matrices Dot Product Linear Mapping Differentiation & Gradient Chain Rule

Data Preprocessing & Feature Engineering

Intermediate

Model quality is decided here. Not in the algorithm you pick. Not in the hyperparameters you tune. In the data you feed the model.

A clean dataset with thoughtfully built features and a simple algorithm will almost always outperform a messy dataset pushed through a sophisticated one. Real-world data science work is roughly 70–80% data preparation. Most tutorials underprepare learners for this, which is why junior hires often struggle in their first few months on the job.

Data Preprocessing Topics
Introduction to Preprocessing Data Cleaning Handling Missing Data Handling Outliers Feature Selection Feature Engineering Train / Test Splitting

Missing values aren’t just annoying — they’re informative. Why data is missing often matters as much as what it is. Was a field intentionally left blank? Did a sensor fail? Each scenario calls for a different response. Outliers get similar treatment: sometimes it’s a data entry error, sometimes it’s the most interesting observation in the dataset.

Exploratory Data Analysis (EDA)

Intermediate

Most people treat EDA as a box to check before the real work starts. That’s backwards.

EDA is where you actually understand your data. It’s where you find that your target variable is heavily imbalanced, that two features are nearly perfectly correlated, or that one segment has a completely different distribution from everything else. Miss these things and your model will fail — quietly, expensively, and in production where it matters most.

🔍 EDA Topics
EDA Introduction EDA Process Step by Step Identifying Correlations Statistical Analysis

If something looks strange in the distributions, chase it. The best insights in EDA almost always start with an anomaly someone nearly ignored.

Data Visualization

Beginner → Intermediate

Visualization isn’t the final step. It runs through every phase of data science work — EDA, modeling, and communication. A data scientist who can’t present results visually is limited to audiences willing to read raw numbers. In practice, that’s nobody.

Tool Best For Learning Curve Output
Matplotlib Full control, custom charts Medium Static
Seaborn Statistical plots, fast setup Low Static
Plotly Interactive charts, dashboards Medium Interactive
Power BI Business intelligence, stakeholder reports Low–Medium Interactive dashboard
Tableau Visual analytics, design flexibility Medium Interactive dashboard
✏️ Visualization Topics
Visualization with Matplotlib Visualization with Seaborn Plotly for Interactive Charts Power BI Introduction Power Query & DAX Power BI Dashboards Tableau Introduction Tableau Dashboards

Machine Learning

Intermediate 8–12 Weeks Core

Here’s a framing most courses get exactly wrong: machine learning isn’t primarily about choosing the right algorithm. It’s about defining the right problem.

A model optimized for accuracy on an imbalanced dataset can score 97% and be completely useless. A regression model applied to a classification problem will technically run and produce nonsense. The judgment call — what to build, what to measure, what failure looks like in this specific context — is the part that can’t be automated. And it’s the part that takes years to actually develop.

🤖 ML Fundamentals
ML Introduction Supervised Learning Unsupervised Learning Regression Techniques Classification Algorithms Gradient Descent Regularization Clustering Dimensionality Reduction Evaluation Metrics ⭐ Cross-Validation Hyperparameter Tuning Tree-Based Models Ensemble Learning

On evaluation metrics

Accuracy is almost never the right metric. Learn precision, recall, F1, ROC-AUC, RMSE, MAE, and R². More importantly, learn what it costs to be wrong in one direction vs the other for the problem you’re actually solving. A false negative in medical screening is not the same problem as a false positive in spam detection.

Deep Learning

Advanced

Don’t start here.

Deep learning is powerful — and it’s where some of the most interesting work in the field is happening right now. But it requires a solid foundation in ML fundamentals, linear algebra, and optimization. Jumping to neural networks before you’ve built real intuition for why simpler models fail is how people end up with black-box systems they can’t debug, interpret, or defend to a stakeholder. Work through the ML section first.

🧠 Deep Learning Topics
Neural Networks Introduction Artificial Neural Networks (ANNs) Perceptron Optimization Algorithms CNNs — Computer Vision Transfer Learning RNNs — Sequence Data LSTM & GRU Transformers ⭐ Seq2Seq Models Autoencoders GANs PyTorch — Getting Started TensorFlow Overview

Understanding Transformers is no longer advanced niche knowledge. In 2026, it’s a standard expectation for anyone working near LLMs or modern NLP. The self-attention mechanism — the core innovation — allows a model to weigh the relevance of every input token against every other simultaneously, regardless of distance. That’s worth understanding, not just accepting as a black box.

Generative AI & LLMs for Data Scientists (2026)

Advanced

This section doesn’t exist in most data science tutorials. That’s the problem.

The data science workflow in 2026 looks nothing like 2022. LLMs aren’t the competition — they’re tools that now sit inside the workflow for code generation, EDA acceleration, natural language querying, feature suggestion, and automated documentation. I think data scientists who treat these tools as optional are making a strategic mistake that’s going to compound over the next two years.

In practice though, fluency with these tools rewards technical depth, not shortcuts. The people who get the most out of AI coding assistants are those who know enough to catch what they get wrong.

GenAI & LLM Topics
How LLMs Changed DS Workflows AI Coding Assistants for DS RAG — What DS Needs to Know Vector Databases (Pinecone, Chroma) Fine-Tuning vs Prompting LangChain for Data Scientists Hugging Face Model Hub LLM Evaluation & Benchmarking

Fine-tuning vs prompting — the short answer

Try prompting first, exhaustively. Fine-tune only if prompting fails repeatedly on the specific behavior you need. Fine-tuning costs money, time, and infrastructure. Prompting costs almost nothing. Most teams jump to fine-tuning too early.

Cloud Platforms & MLOps

Advanced

Most tutorials teach you how to build a model on your laptop. Most jobs require you to build a model that runs in production, handles real traffic, monitors itself for data drift, and gets retrained when performance degrades.

That gap is MLOps. It’s the difference between candidates who say “I built this” and those who can say “I shipped this.” Hiring managers know the difference immediately.

☁️ Cloud & MLOps Topics
AWS SageMaker Introduction Google Vertex AI Overview Azure Machine Learning MLOps Fundamentals Model Versioning Drift Monitoring MLflow — Experiment Tracking DVC — Data Version Control Weights & Biases

I’ll be direct: the gap between “trained a model” and “deployed a model” is where a lot of promising candidates stall. Portfolios with genuinely impressive notebooks fall flat in interviews when the candidate has never run anything in a cloud environment. It’s a fixable problem — but only if you know it exists.

Data Science Projects — Build Your Portfolio

Here’s the uncomfortable reality most tutorials skip: most data science portfolios look exactly the same.

Titanic survival prediction. Iris flower classification. House price regression on the Ames dataset. These projects are fine for learning the mechanics. They are a liability in a job search — hiring managers have seen each of them thousands of times. A portfolio that leads with these signals that you completed tutorials, not that you can solve real problems.

📁 Projects by Level
Beginner Customer Churn Prediction Beginner Public Health Trend Analysis Beginner Sentiment Analysis on Reviews Intermediate Recommendation System Intermediate Sales Forecasting Dashboard Intermediate Credit Risk Model + SHAP Advanced Deployed RAG Pipeline Advanced Top-25% Kaggle Competition Advanced End-to-End Deployed Model with Monitoring

Every project on GitHub needs three things: a README that explains the problem and the result in plain language (not just the code); a notebook with readable commentary throughout each step; and a brief write-up explaining what you tried, what failed, and what you’d do differently. That write-up is what almost no one does — and it’s what shows analytical thinking, not just code execution.

Careers in Data Science — Roles, Salaries & Job Market

The “data scientist” title covers an enormous range of actual jobs. Understanding the specific distinctions helps you target your learning and your applications far more precisely than a generic path.

Data Scientist vs Data Analyst vs ML Engineer vs Data Engineer

Role Core Focus Key Tools Entry Bar
Data Analyst What happened? (backward-looking) SQL, Excel, Tableau, Power BI Lowest — most accessible entry point
Data Scientist What will happen? (predictive) Python, ML libraries, statistics Medium — requires solid Python + stats
ML Engineer Making models production-ready Python, cloud platforms, MLOps tools High — closest to software engineering
Data Engineer Building data infrastructure SQL, Python, Spark, dbt, Airflow Medium-High — currently highest demand

Salary Benchmarks — 2026

Entry-level Analyst
$60k–$85k
Mid-level DS
$110k–$150k
Senior DS
$150k–$195k
ML Engineer
$130k–$195k
Senior DE
$130k–$180k

Location and sector shift these figures substantially. Finance and tech roles skew considerably higher.

What Employers Actually Look For

Technical skills get you the interview. Three things tend to get you the offer: the ability to communicate results clearly to non-technical stakeholders, demonstrated project work that shows judgment rather than just code execution, and strong SQL. Hiring managers report consistently that SQL fluency is undervalued by candidates and overweighted in actual screening. Don’t treat it as a formality.

Top Certifications Worth Getting in 2026

Google Data Analytics Certificate IBM Data Science Professional Certificate AWS Certified ML — Specialty Databricks Certified Associate (Spark) DeepLearning.AI ML Specialization

Data Science Interview Prep

The interview process for data science roles is its own discipline. Technical rounds test different things than portfolio reviews. And the format of a structured technical interview is artificial enough that knowing the material isn’t sufficient if you haven’t practiced performing it under pressure.

📋 Interview Topics
Python Interview Questions (50 problems) SQL Interview Questions with Solutions Statistics & Probability Questions ML Concept Questions Case Study & Take-Home Tips Behavioral Questions for DS Roles

On take-home projects

Read the brief twice before writing a single line of code. Document your reasoning throughout the notebook, not just in the conclusion. Frame results in terms of business impact, not model metrics alone. Most candidates fail take-homes not on technical quality but on communication.

Shalki Aggarwal is a Software Engineer II at Microsoft and an AI & Data Science expert specializing in Generative AI, Agentic AI, Python, LangChain, LangGraph, CrewAI, Deep Agents, and Loop Engineering. She is also a corporate trainer for leading organizations including L&T, Bharat Petroleum, Luminous, Denso, and Toshiba Midea, helping teams apply AI and emerging technologies to real-world business challenges.