this post was submitted on 16 Sep 2023
86 points (96.7% liked)
Canada
7185 readers
347 users here now
What's going on Canada?
Communities
π Meta
πΊοΈ Provinces / Territories
- Alberta
- British Columbia
- Manitoba
- New Brunswick
- Newfoundland and Labrador
- Northwest Territories
- Nova Scotia
- Nunavut
- Ontario
- Prince Edward Island
- Quebec
- Saskatchewan
- Yukon
ποΈ Cities / Local Communities
- Calgary (AB)
- Edmonton (AB)
- Greater Sudbury (ON)
- Halifax (NS)
- Hamilton (ON)
- Kootenays (BC)
- London (ON)
- Mississauga (ON)
- Montreal (QC)
- Nanaimo (BC)
- Oceanside (BC)
- Ottawa (ON)
- Port Alberni (BC)
- Regina (SK)
- Saskatoon (SK)
- Thunder Bay (ON)
- Toronto (ON)
- Vancouver (BC)
- Vancouver Island (BC)
- Victoria (BC)
- Waterloo (ON)
- Winnipeg (MB)
π Sports
Hockey
- List of All Teams: Post on /c/hockey
- General Community: /c/Hockey
- Calgary Flames
- Edmonton Oilers
- MontrΓ©al Canadiens
- Ottawa Senators
- Toronto Maple Leafs
- Vancouver Canucks
- Winnipeg Jets
Football (NFL)
- List of All Teams:
unknown
Football (CFL)
- List of All Teams:
unknown
Baseball
- List of All Teams:
unknown - Toronto Blue Jays
Basketball
- List of All Teams:
unknown - Toronto Raptors
Soccer
- List of All Teams:
unknown - General Community: /c/CanadaSoccer
- Toronto FC
π» Universities
π΅ Finance / Shopping
- Personal Finance Canada
- BAPCSalesCanada
- Canadian Investor
- Buy Canadian
- Quebec Finance
- Churning Canada
π£οΈ Politics
- Canada Politics
- General:
- By Province:
π Social and Culture
Rules
Reminder that the rules for lemmy.ca also apply here. See the sidebar on the homepage:
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
At the bottom of the chain on mastodon the creator says they use the search APIs of the store websites. I wouldn't have expected those to be easily accessible!
Yeah a lot of chains even have a documented, developer-friendly API. If that's not available though, you can usually figure out the API just by looking at the calls your browser makes when visiting a page. Most sites use a REST API for catalog pages that's then rendered out with JavaScript.
If that doesn't work, then you can usually scrape everything with Selenium. It's a little harder to do, but still quite manageable, though that usually has to be a background job, as it's slow.