ShelfScan - Walmart store run 20261018-100115

Count by category

Health & Wellness98

Personal Care98

Household Essentials97

Food96

Office Supplies94

Feeding90

Art Supplies88

Beauty84

Diapering79

Balloons53

Pets53

repeat placements removed 2202 · sponsored placements seen 950 · marketplace dropped 17 · shipping-only dropped 149 · approx-weight dropped 3

Field completeness

zipcode100.0%

store_name100.0%

store_location100.0%

store_logo100.0%

store_brand100.0%

category100.0%

sub_category100.0%

product_title100.0%

weight88.2%

regular_price100.0%

sale_price6.9%

volume_deals_description0.0%

volume_deals_price0.0%

digital_deals_description0.0%

digital_deals_price0.0%

image_url100.0%

url100.0%

upc96.2%

gupc0.0%

ppm75.3%

unit_price0.0%

crawl_date100.0%

Store + fulfillment proof

Run start

Run end

1,126 pages checked during the run: pickup store must be 5402 with intent PICKUP. Walmart-side drifts caught and recovered: 2; item pages not used because the store stayed unconfirmed: 0. Wrong-store pages kept: 0.
Listings requested with Walmart's own filters In-store + Retailer: Walmart; every record also checked for a Walmart seller and a pickup/in-store offer at this store.
Sponsored placements never create a record when the same item appears organically; one record per Walmart item id.

Validation of this run

schema_22_fields_in_order_no_nullspass
gupc_and_unit_price_emptypass
crawl_date_is_run_datepass
min_total_recordspass
no_duplicate_productspass
upc_repeats_infopass
store_verified_at_startpass
store_verified_at_endpass
no_location_mismatch_during_runpass
item_page_store_unconfirmed_below_5pctpass
no_failed_or_blocked_categorypass
no_empty_categorypass
no_abnormally_thin_category_vs_last_goodpass

Prices, PPM, deals

PPM is Walmart's displayed unit price text (for example 12.1 ¢/oz, $17.92/lb), never calculated: 700 of 930 records.
Sale price = Walmart's "was / now" (Rollback, Reduced Price, Clearance): 64 records.
Volume deals: 0 · digital deals: 0. Only wording Walmart displays is stored; nothing is inferred. Walmart Cash, cash back and card offers are never treated as digital deals.
Private label (Great Value, Equate, Parent's Choice ...): 241 records.
gupc and unit_price are empty strings, as required.

Browse the data

	Title	Category	Sub	Weight	Regular	Sale	PPM	UPC	Brand

How it works

Categories from the supplied CSV, expanded into Walmart's own departments; paginated listings, split when Walmart caps a listing.
Store chosen in Walmart's store finder and verified on every page; a drift is re-verified and refetched, a listing that stays wrong stops the run, an item page that stays wrong is not used.
Item pages add UPC, size, full image and deal tiers; known items reuse a 90-day cache.
SQLite checkpoint after every page; --resume continues an interrupted run.
Validation gates publishing: a failed, blocked, empty or thin run never replaces the last good dataset.

Python 3.12, Playwright, Google Chrome, SQLite, Docker.
Azure Container Apps Job, twice weekly (Mon + Thu), parallelism 1, Azure Files for state, Blob for published data.
Estimated cost per store: about $20 - 60 / month including a US proxy plan.
Full unencrypted source, deploy scripts, docs and a walkthrough are delivered on award.