What can you do with the page endpoint?
- Scrape availability and pricing from product detail page urls
- When used in combination with a sitemap: scrape the full contents of a webshop
- Scrape content and images from product detail page urls
API response
| request_id | unique ShoppingScraper request_id | |
| query link | link | the requested url from ShoppingScraper |
| endpoint | type | page endpoint |
| app | found webshop | |
| metadata | additional metadata to be used for your own internal references | |
| geo | country | selected country for request |
| language | selected language | |
| status | response | response from API request |
| message | status message of response | |
| stats | results | number of offers found on this page |
| timestamp | record of the time of the request | |
| pagespeed | amount of seconds of request | |
| results | classification | type of data returned |
| title | matched product title with EAN | |
| brand | brand of the product | |
| category | name of the category and urls associated with the breadcrumb | |
| mpn/ean | found mpn or ean on the product page | |
| sku | Google Shopping product id or doc id | |
| link | Google Shopping URL of matched product | |
| currency | used currency of country | |
| stats offers | number of sellers found for this EAN | |
| offers price | price of product at specific seller offer | |
| offers shipment | shipment type of seller offer | |
| offers shippingCosts | shipping costs of specific seller offer | |
| offers totalPrice | total price incl. shipping of specific seller offer | |
| offers seller | seller name | |
| offers availability | availability of specific product offer | |
| offers state | state of specific product offer | |
| offers ranking | ranking of product offer | |
| content specs | specifications found | |
| content description | description found | |
| content images | multiple images found | |
| reviews scale | maximum score given for review | |
| reviews rating | average rating of product | |
| reviews count | total count of number of reviews |
 Register now and get 100 credits for free! |
|
Parameters
| Description | Example values | |
| metadata | Add your own metadata to your request, will be added to the payload | internal product id = 5555 |
| url | Add the url of the product detail page here | https://www.ikea.com/gb/en/p/billy-bookcase-white-00263850/ |
| api_key | Your ShoppingScraper API key | no example to show here 😉 |
Geolocation
We retrieve the product detail page from various data connections. Currently we don't offer to select the geolocation, this is on our roadmap.
Sample URL
https://api.shoppingscraper.com/page/?api_key={API_KEY}&url={URL}&metadata={producitd:5555}
Sample payload
{
"shoppingscraper": {
"request_id": "85a845e3-b5a9-4e60-a6b6-a38f7c8c538e",
"query": {
"link": "http://api.shoppingscraper.com/page/?api_key=xxxxxx&url=https://www.ikea.com/gb/en/p/billy-bookcase-white-00263850/"
},
"endpoint": {
"type": "page",
"app": "ikea"
},
"metadata": {
},
"geo": {
"country": "uk",
"language": "en"
},
"status": {
"response": 200,
"message": "OK"
},
"stats": {
"results": 1,
"timestamp": "Tue Aug 08 2022 11:22:38 UTC+0000",
"pagespeed": 1.749
},
"results": [
{
"classification": "product",
"title": "BILLY Bookcase - white 80x28x202 cm",
"brand": "IKEA",
"category": [
{
"name": "Products",
"url": "https://www.ikea.com/gb/en/cat/products-products/"
},
{
"name": "Storage & organisation",
"url": "https://www.ikea.com/gb/en/cat/storage-organisation-st001/"
},
{
"name": "Bookcases & shelving units",
"url": "https://www.ikea.com/gb/en/cat/bookcases-shelving-units-st002/"
},
{
"name": "Bookcases",
"url": "https://www.ikea.com/gb/en/cat/bookcases-10382/"
},
{
"name": "BILLY Bookcase",
"url": "https://www.ikea.com/gb/en/p/billy-bookcase-white-00263850/"
}
],
"mpn": "002.638.50",
"extended": {
},
"sku": "002.638.50",
"link": "https://www.ikea.com/gb/en/p/billy-bookcase-white-00263850/",
"currency": "GBP",
"ranking": {
},
"stats": {
"offers": 1
},
"offers": [
{
"price": 50.0,
"shipment": "standard",
"shippingCosts": 0.0,
"seller": "IKEA",
"availability": "InStock",
"state": "new",
"ranking": {
"productList": 1
}
}
],
"content": {
"specs": [
],
"description": "BILLY Bookcase - white 80x28x202 cm. Adjustable shelves; adapt space between shelves according to your needs. A simple unit can be enough storage for a limited space or the foundation for a larger storage solution if your needs change. Min. ceiling height required: 205 cm.",
"images": [
"https://www.ikea.com/gb/en/images/products/billy-bookcase-white__0625599_pe692385_s5.jpg",
"https://www.ikea.com/gb/en/images/products/billy-bookcase-white__1051924_pe845813_s5.jpg",
"https://www.ikea.com/gb/en/images/products/billy-bookcase-white__0394567_pe561390_s5.jpg",
"https://www.ikea.com/gb/en/images/products/billy-bookcase-white__0249652_pe387976_s5.jpg",
"https://www.ikea.com/gb/en/images/products/billy-bookcase-white__1065929_ph181488_s5.jpg",
"https://www.ikea.com/gb/en/images/products/billy-bookcase-white__1065928_ph182491_s5.jpg",
"https://www.ikea.com/gb/en/images/products/billy-bookcase-white__1065965_ph158750_s5.jpg",
"https://www.ikea.com/gb/en/images/products/billy-bookcase-white__1065956_ph161331_s5.jpg",
"https://www.ikea.com/gb/en/images/products/billy-bookcase-white__0546689_pe656300_s5.jpg"
],
"reviews": {
"scale": 5,
"rating": 4.7,
"count": 173
}
},
"thumbnail": "https://www.ikea.com/gb/en/images/products/billy-bookcase-white__0625599_pe692385_s5.jpg",
"reviews": {
}
}
]
}
}
| Register now and get 100 credits for free! |
|