Daily Stock Data Ingestion Pipeline

An R workflow that collected daily stock data, joined company information, and wrote derived features to SQL for dashboards.

RSQLWeb ScrapingYahoo FinancePower BIWeb ScrapingFeature EngineeringSQL PipelinesMarket Data

Outcome: Created a repeatable daily feed of market data and derived features for SQL-backed dashboards.

Task

The dashboards needed daily stock prices alongside company and financial information. Collecting prices alone would not provide the inputs required for analysis.

Build

I built an R workflow that:

scraped daily data from Yahoo Finance
loaded company information and financial-report fields
joined the sources and calculated volatility- and valuation-related features
wrote output tables to SQL for dashboard use

Result

Scheduled extraction, joins, and feature calculations produced a recurring data feed for Power BI. The project gave me experience preparing external data for repeated analysis rather than one-off imports.