Investing.com Scraper for Quotes, Calendars and Price History

Investing.com Data We Extract by Asset Class

Investing.com gives each instrument a readable address - /equities/apple-computer-inc, /commodities/gold, /currencies/eur-usd, /rates-bonds/u.s.-10-year-bond-yield - and hangs its sub-pages off the same slug with suffixes such as -historical-data, -technical and -company-profile. Another listing of the same company on a second exchange is picked with a cid parameter, so slug and cid together form the row key. The fields change with the asset class:

• Stocks - name, ticker, exchange, currency, last price, change and percent change, market status, Prev. Close, Open, Day's Range, 52 wk Range, Volume, Average Vol. (3m), Market Cap, Shares Outstanding, Revenue, Net Income, EPS, P/E Ratio, Price/Book, Beta, Dividend (Yield), 1-Year Change and Next Earnings Date.
• Commodities - the front contract code (GCZ6 on the gold page), Unit, Contract Size, Tick Size, Tick Value, Point Value, Settlement Type, Settlement Day, Last Rollover Day and Months, plus the related contracts listed on CME, TOCOM and other venues.
• Bonds - yield, change, Price, Price Open, Coupon and Maturity Date for government bonds such as the U.S. 10Y.
• Currencies - Bid, Ask, Day's Range and the Type, Group, Base and Second labels that file EUR/USD as a Major pair.
• Cryptocurrency - price in USD, Vol (24H), Market Cap, Rank, Circulating Supply, Max Supply and the change over seven days, one month, one year and YTD.
• Analysts and owners - the consensus, the 12-month average price target, the analyst ratings table with Firm, Position, Price Target, Upside/Downside, Action and Date, and the Top Holders table with % of holding, Shares Held, Date Reported and Value.
• Technical summary - the Summary, Technical Indicators and Moving Averages gauges, from Strong Sell to Strong Buy, for each timeframe from 1 Min to Monthly.

Fair Value, ProTips and the other InvestingPro figures belong to a paid tier and stay out of the dataset; everything listed above is what a visitor reads on the free page.

Investing.com Historical Data and Calendars

The Historical Data tab is a table of Date, Price, Open, High, Low, Vol. and Change % with a Time Frame selector and a date range, closed by Highest, Lowest, Difference, Average and Change % for the window. We walk the range on the page itself, so a stock price history, a gold price history or a bitcoin price history arrives as dated rows on the same columns.

Calendars are the other half. The economic calendar lists Time, Cur., Event, Imp., Actual, Forecast and Previous, rates importance with one to three stars, filters by country, category and importance, and runs tabs from Yesterday to Next Week. Each event links to a page of its own - Nonfarm Payrolls, for one - with the source agency, a description and a release table of Release date, Time, Actual, Forecast and Previous. The earnings calendar shows EPS / Forecast, Revenue / Forecast, Market Cap and a before-open or after-close marker; the dividend calendar shows Ex-Dividend Date, Dividend, Type, Payment Date and Yield, with Type read from a legend that runs from Monthly, Quarterly and Semi-Annual to Interim, Final and Bonus. The holiday calendar uses the same date tabs for Date, Country, Exchange Name and Holiday.

Country stock lists close the loop: /equities/germany returns Name, Last, High, Low, Chg., Chg. %, Vol. and Time for an index picked from a selector that holds DAX, SDAX, TecDAX and the DAX sector indices, which is how we enumerate a market before visiting each stock.