Web scraping may appear simple initially, with a multitude of open-source libraries, frameworks, scraping APIs, and extraction tools available that can save you time when collecting data. However, when you need to extensively scrape and gather data, you may encounter … Read More
API – Twitter
Get the right data from Twitter to stay ahead of the game
Twitter is a big social network with more than 200 millions members, 9120 tweets are sent every second.
Popular with users for getting quickly informed, following trends or giving their opinion, Twitter has a lot of interesting marketing data for brands.
Collect this data to know more your audience, or to be informed of something you need.
Our Twitter web scraping API is ready to automatically retrieve the data you want without getting blocked.
Start collecting data from Twitter profiles and hashtags.
For this API, you can get:
Check our documentation
Scraping Twitter profile
Our Twitter web scraping API allows you to retrieve informations from Twitter profile pages.
Enter a Twitter profile URL and get the data you need from it:
- Profile name
- Profile image
- Profile background image
- Number of tweets
- Account verification
- Profile bio
- Number followed
- Number followers
- Latest posts data
- Text
- Time
- ID
- Replies
- Retweets
- Likes
- Views
- Media
And here is what you get ⤵
[
{
"posts": 14658,
"profile_background_image_url": "https://pbs.twimg.com/profile_banners/44196397/1576183471",
"profile_image_url": "https://pbs.twimg.com/profile_images/1404334078388670466/DgO3WL4S_normal.jpg",
"profile_name": "Elon Musk",
"isVerified": true,
"bio": "",
"following": 108,
"followers": 57706733,
"posts_info": [
{
"text": "Super Heavy moves tomorrow https://t.co/qHG1SYO46S",
"time": "Thu Jul 01 09:57:18 +0000 2021",
"id": "1410537991236243461",
"media_url": "https://pbs.twimg.com/media/E5M80tXXMAI3A5A.jpg",
"replies": 3970,
"retweets": 5154,
"likes": 68720
},
{
"text": "Baby Doge, doo, doo, doo, doo, doo,\nBaby Doge, doo, doo, doo, doo, doo,\nBaby Doge, doo, doo, doo, doo, doo,\nBaby Doge",
"time": "Thu Jul 01 09:24:21 +0000 2021",
"id": "1410529698497630212",
"replies": 25033,
"retweets": 24300,
"likes": 135638
},
{
"text": "Release the Doge! https://t.co/9bXCWQLIhu",
"time": "Thu Jul 01 08:43:41 +0000 2021",
"id": "1410519466518233089",
"media_url": "https://pbs.twimg.com/media/E5Mr-oXXwAEWFtP.jpg",
"replies": 8497,
"retweets": 11119,
"likes": 73370
},
{
"text": "Stop gendering memes … I mean mimes",
"time": "Thu Jul 01 08:42:11 +0000 2021",
"id": "1410519086417813510",
"replies": 4173,
"retweets": 3850,
"likes": 56947
},
{
"text": "RT @SpaceX: Tracking footage of Falcon 9 landing on LZ-1 https://t.co/uCR2ZuDSG7",
"time": "Thu Jul 01 00:30:30 +0000 2021",
"id": "1410395351836725249",
"media_url": "https://pbs.twimg.com/ext_tw_video_thumb/1410392678173483012/pu/img/Mgzgc6aRyx9OSFFK.jpg",
"replies": 0,
"retweets": 10530,
"likes": 0,
"views": 1245022
},
{
"text": "Rapidly Reusable Rockets, R R R 🏴☠️",
"time": "Wed Jun 30 20:11:10 +0000 2021",
"id": "1410330088906838018",
"replies": 8531,
"retweets": 7254,
"likes": 115122
},
{
"text": "RT @SpaceX: Falcon 9’s first stage has landed on Landing Zone 1! https://t.co/26M9Ptomg7",
"time": "Wed Jun 30 19:41:47 +0000 2021",
"id": "1410322692436283394",
"media_url": "https://pbs.twimg.com/amplify_video_thumb/1410322221856219138/img/MXYC_823uXA3vbBh.jpg",
"replies": 0,
"retweets": 7526,
"likes": 0,
"views": 1762890
},
{
"text": "RT @SpaceX: Liftoff! https://t.co/0icqQUWNSH",
"time": "Wed Jun 30 19:33:55 +0000 2021",
"id": "1410320714679324683",
"media_url": "https://pbs.twimg.com/amplify_video_thumb/1410320114109456384/img/WBe0efuAC6YSm2Ji.jpg",
"replies": 0,
"retweets": 3778,
"likes": 0,
"views": 939097
},
{
"text": "RT @SpaceX: Watch Falcon 9 launch 88 spacecraft to orbit → https://t.co/bJFjLCzWdK https://t.co/y3JRM5cDd3",
"time": "Wed Jun 30 19:29:13 +0000 2021",
"id": "1410319531558543361",
"replies": 0,
"retweets": 2198,
"likes": 0
},
{
"text": "RT @SpaceX: Live webcast of the Transporter-2 mission → https://t.co/bJFjLCzWdK https://t.co/ai5Mq5ytdv",
"time": "Tue Jun 29 18:46:33 +0000 2021",
"id": "1409946405150597126",
"replies": 0,
"retweets": 3311,
"likes": 0
},
{
"text": "RT @SpaceX: Falcon 9 and 88 spacecraft are vertical on pad 40 ahead of today’s launch. The 58-minute window opens at 2:56 p.m. EDT, and the…",
"time": "Tue Jun 29 14:57:18 +0000 2021",
"id": "1409888714206199813",
"replies": 0,
"retweets": 2596,
"likes": 0
},
{
"text": "Thanks for all the happy birthday wishes!",
"time": "Mon Jun 28 20:25:03 +0000 2021",
"id": "1409608806875615242",
"replies": 36381,
"retweets": 16429,
"likes": 370953
},
{
"text": "https://t.co/HStnXM0zmn",
"time": "Sun Jun 27 14:11:23 +0000 2021",
"id": "1409152382345244684",
"media_url": "https://pbs.twimg.com/media/E45Qn5MVUAIfsCz.jpg",
"replies": 14309,
"retweets": 25207,
"likes": 309399
},
{
"text": "All 72 orbital planes activate in August, plus many other improvements, enabling global coverage, except for polar regions, which will take another 6 months",
"time": "Fri Jun 25 22:58:58 +0000 2021",
"id": "1408560379463077891",
"replies": 3141,
"retweets": 3311,
"likes": 60962
},
{
"text": "Starlink simultaneously active users just exceeded the strategically important threshold of 69,420 last night!",
"time": "Fri Jun 25 22:51:28 +0000 2021",
"id": "1408558492009566214",
"replies": 11022,
"retweets": 12594,
"likes": 167915
},
{
"text": "My Shiba Inu will be named Floki",
"time": "Fri Jun 25 11:03:04 +0000 2021",
"id": "1408380216653844480",
"replies": 39093,
"retweets": 38139,
"likes": 300928
},
{
"text": "Timing is everything https://t.co/B6HDB5kS4G",
"time": "Fri Jun 25 10:42:24 +0000 2021",
"id": "1408375014261395462",
"media_url": "https://pbs.twimg.com/media/E4uNnHvX0AMGPeT.jpg",
"replies": 8195,
"retweets": 17216,
"likes": 207563
},
{
"text": "RT @m_tijn: Accidentally deleted this tweet, so here it is again!\n#EpicRocketRender #liftoff #spaceX #launchTower #Blender3d https://t.co/Q…",
"time": "Fri Jun 25 02:32:22 +0000 2021",
"id": "1408251692811014145",
"replies": 0,
"retweets": 954,
"likes": 0
}
]
}
]
Scraping Twitter search results
Retrieve all the data related to search results from a keyword or hashtag with our web scraping API.
Fill in the keyword or hashtag, and get the data you need from the search results:
- Username
- Tweet URL
- Created time
- ID
- Other hashtags
- User mentions
- Source
- Geo coordinates
- Reply count
- Quote count
- Conversation ID
- Retweeted
- Possibly sensitive
- Language
- Media data:
- Links
- Expanded URL
- Type
- Width and height
And here is what you get ⤵
[
{
"created_at": "Thu Jul 01 09:42:27 +0000 2021",
"id": 1410534253427839000,
"id_str": "1410534253427838978",
"full_text": "This #BeyondProtocol project really seems like a big deal. They have an already impressive team that's bringing in even more major names. Don't sleep on this one\n\n#IoT #blockchain #Ethereum #Bitcoin #DYOR\n\nhttps://t.co/cwLMcuM1jQ\nhttps://t.co/Hp8KMtzE3T",
"truncated": false,
"display_text_range": [
0,
253
],
"entities": {
"hashtags": [
{
"text": "BeyondProtocol",
"indices": [
5,
20
]
},
{
"text": "IoT",
"indices": [
163,
167
]
},
{
"text": "blockchain",
"indices": [
168,
179
]
},
{
"text": "Ethereum",
"indices": [
180,
189
]
},
{
"text": "Bitcoin",
"indices": [
190,
198
]
},
{
"text": "DYOR",
"indices": [
199,
204
]
}
],
"symbols": [],
"user_mentions": [],
"urls": [
{
"url": "https://t.co/cwLMcuM1jQ",
"expanded_url": "http://t.me/beyondprotocol",
"display_url": "t.me/beyondprotocol",
"indices": [
206,
229
]
},
{
"url": "https://t.co/Hp8KMtzE3T",
"expanded_url": "http://beyond.link",
"display_url": "beyond.link",
"indices": [
230,
253
]
}
]
},
"source": "<a href=\"http://twitter.com/download/iphone\" rel=\"nofollow\">Twitter for iPhone</a>",
"in_reply_to_status_id": null,
"in_reply_to_status_id_str": null,
"in_reply_to_user_id": null,
"in_reply_to_user_id_str": null,
"in_reply_to_screen_name": null,
"user_id": 59134890,
"user_id_str": "59134890",
"geo": null,
"coordinates": null,
"place": null,
"contributors": null,
"is_quote_status": true,
"quoted_status_id": 1410281814279741400,
"quoted_status_id_str": "1410281814279741440",
"quoted_status_permalink": {
"url": "https://t.co/mUESiUPBks",
"expanded": "https://twitter.com/beyondprotocol1/status/1410281814279741440",
"display": "twitter.com/beyondprotocol…"
},
"retweet_count": 529,
"favorite_count": 500,
"reply_count": 6,
"quote_count": 0,
"conversation_id": 1410534253427839000,
"conversation_id_str": "1410534253427838978",
"favorited": false,
"retweeted": false,
"possibly_sensitive": false,
"possibly_sensitive_editable": true,
"card": {
"name": "summary",
"url": "https://t.co/cwLMcuM1jQ",
"card_type_url": "http://card-type-url-is-deprecated.invalid",
"binding_values": {
"vanity_url": {
"type": "STRING",
"string_value": "t.me",
"scribe_key": "vanity_url"
},
"app_is_free": {
"type": "STRING",
"string_value": "true"
},
"app_price_currency": {
"type": "STRING",
"string_value": "USD"
},
"app_price_amount": {
"type": "STRING",
"string_value": "0.0"
},
"domain": {
"type": "STRING",
"string_value": "t.me"
},
"app_num_ratings": {
"type": "STRING",
"string_value": "118,817"
},
"app_star_rating": {
"type": "STRING",
"string_value": "4.28279"
},
"app_name": {
"type": "STRING",
"string_value": "Telegram Messenger"
},
"site": {
"type": "USER",
"user_value": {
"id_str": "1689053928",
"path": []
},
"scribe_key": "publisher_id"
},
"title": {
"type": "STRING",
"string_value": "Beyond Protocol"
},
"description": {
"type": "STRING",
"string_value": "You can view and join @beyondprotocol right away."
},
"thumbnail_image_small": {
"type": "IMAGE",
"image_value": {
"url": "https://pbs.twimg.com/card_img/1409657823785406466/1S5bJC8I?format=jpg&name=100x100_2",
"width": 100,
"height": 100,
"alt": null
}
},
"thumbnail_image": {
"type": "IMAGE",
"image_value": {
"url": "https://pbs.twimg.com/card_img/1409657823785406466/1S5bJC8I?format=jpg&name=144x144_2",
"width": 144,
"height": 144,
"alt": null
}
},
"thumbnail_image_large": {
"type": "IMAGE",
"image_value": {
"url": "https://pbs.twimg.com/card_img/1409657823785406466/1S5bJC8I?format=jpg&name=420x420_2",
"width": 320,
"height": 320,
"alt": null
}
},
"thumbnail_image_x_large": {
"type": "IMAGE",
"image_value": {
"url": "https://pbs.twimg.com/card_img/1409657823785406466/1S5bJC8I?format=png&name=2048x2048_2_exp",
"width": 320,
"height": 320,
"alt": null
}
},
"thumbnail_image_original": {
"type": "IMAGE",
"image_value": {
"url": "https://pbs.twimg.com/card_img/1409657823785406466/1S5bJC8I?format=jpg&name=orig",
"width": 320,
"height": 320,
"alt": null
}
},
"card_url": {
"type": "STRING",
"string_value": "https://t.co/cwLMcuM1jQ",
"scribe_key": "card_url"
}
},
"users": {
"1689053928": {
"id": 1689053928,
"id_str": "1689053928",
"name": "Telegram Messenger",
"screen_name": "telegram",
"location": "",
"description": "Simple, fast, secure – and synced across all your devices. One of the top 10 most-used apps in the world with over 500 million active users.",
"url": "https://t.co/9G92kS0yd7",
"entities": {
"url": {
"urls": [
{
"url": "https://t.co/9G92kS0yd7",
"expanded_url": "http://telegram.org",
"display_url": "telegram.org",
"indices": [
0,
23
]
}
]
},
"description": {
"urls": []
}
},
"protected": false,
"followers_count": 1006437,
"fast_followers_count": 0,
"normal_followers_count": 1006437,
"friends_count": 117,
"listed_count": 3595,
"created_at": "Wed Aug 21 19:47:05 +0000 2013",
"favourites_count": 6614,
"utc_offset": null,
"time_zone": null,
"geo_enabled": true,
"verified": true,
"statuses_count": 37759,
"media_count": 2328,
"lang": null,
"contributors_enabled": false,
"is_translator": false,
"is_translation_enabled": false,
"profile_background_color": "C0DEED",
"profile_background_image_url": "http://abs.twimg.com/images/themes/theme1/bg.png",
"profile_background_image_url_https": "https://abs.twimg.com/images/themes/theme1/bg.png",
"profile_background_tile": false,
"profile_image_url": "http://pbs.twimg.com/profile_images/1183117696730390529/LRDASku7_normal.jpg",
"profile_image_url_https": "https://pbs.twimg.com/profile_images/1183117696730390529/LRDASku7_normal.jpg",
"profile_banner_url": "https://pbs.twimg.com/profile_banners/1689053928/1392066683",
"profile_image_extensions_alt_text": null,
"profile_image_extensions_media_availability": null,
"profile_image_extensions_media_color": {
"palette": [
{
"rgb": {
"red": 48,
"green": 163,
"blue": 230
},
"percentage": 88.48
},
{
"rgb": {
"red": 255,
"green": 255,
"blue": 255
},
"percentage": 11.14
},
{
"rgb": {
"red": 144,
"green": 208,
"blue": 235
},
"percentage": 0.45
}
]
},
"profile_image_extensions": {
"mediaStats": {
"r": {
"missing": null
},
"ttl": -1
}
},
"profile_banner_extensions_alt_text": null,
"profile_banner_extensions_media_availability": null,
"profile_banner_extensions_media_color": {
"palette": [
{
"rgb": {
"red": 70,
"green": 70,
"blue": 70
},
"percentage": 100
}
]
},
"profile_banner_extensions": {
"mediaStats": {
"r": {
"missing": null
},
"ttl": -1
}
},
"profile_link_color": "1DA1F2",
"profile_sidebar_border_color": "C0DEED",
"profile_sidebar_fill_color": "DDEEF6",
"profile_text_color": "333333",
"profile_use_background_image": true,
"has_extended_profile": false,
"default_profile": true,
"default_profile_image": false,
"pinned_tweet_ids": [
1408423928725393400
],
"pinned_tweet_ids_str": [
"1408423928725393413"
],
"has_custom_timelines": true,
"can_dm": null,
"following": null,
"follow_request_sent": null,
"notifications": null,
"muting": null,
"blocking": null,
"blocked_by": null,
"want_retweets": null,
"advertiser_account_type": "promotable_user",
"advertiser_account_service_levels": [
"analytics"
],
"profile_interstitial_type": "",
"business_profile_state": "none",
"translator_type": "none",
"withheld_in_countries": [],
"followed_by": null,
"ext": {
"highlightedLabel": {
"r": {
"ok": {}
},
"ttl": -1
}
},
"require_some_consent": false
}
},
"card_platform": {
"platform": {
"device": {
"name": "Swift",
"version": "12"
},
"audience": {
"name": "production",
"bucket": null
}
}
}
}
]
Try this API for free
Get started today with free scrapes !
No payment info required.
How to scrape Twitter?
Read our article about how to scrape and collect data from Twitter to see how to use this web scraping API.
User feedbacks
"We love the way how easy it is to set up ScrapingBot!"
Previous
Next
And see it for yourself !
IMPORTANT :
If you are testing on a retail site, do not paste the URL of the homepage or a page with multiple products,
you have to paste a single product page URL 😉
Latest articles
Scraper for Apartments.com
Scraping-bot.io is proud to offer a powerful and easy-to-use web scraping tool for apartments.com. Our scraper is designed to help you extract valuable data from apartments.com quickly and efficiently, giving you the insights you need to make informed decisions. With … Read More
How to scrape real estate listings from Funda ?
Web scraping is essential to keep an eye on the most dynamic markets. We’ve started by developing an API for retail, and have now released a real estate scraping API Below, we’re going to test ScrapingBot on a real estate … Read More