twitter.com/x.com: Advanced features
Our twitter Plugins support some advanced features which will be explained here.
Note about the change to x.com: All examples used in this guide will work for all active Twitter/X domains.
Special URL parameters which can be used as abort conditions for profile crawling
Usage example:
If you want to crawl twitter.com/exampleProfile and only want to crawl the first 50 items, add it like this:
twitter.com/exampleProfile?maxitems=50
Of course you can include both abort conditions at the same time like this:
twitter.com/exampleProfile?max_date=2022-01-15&maxitems=50
This will crawl up to 50 items or tweets until max posted date of 2022-01-14 11:59PM.
The abort condition which is reached first will abort the crawl process.
Special plugin properties that e.g. for custom filenames via Packagizer
| Property key | Description | Example |
| username | Profile name of added profile to crawl / owner of added tweet. | exampleusername |
| date | Date when content was posted in form yyyy-MM-dd | 2022-01-17 |
| date_timestamp | Timestamp in milliseconds of date when content was posted. | 1688670637000 |
| mediaindex |
Index of media in context of single tweet. Useful when adding tweets containing multiple media items. |
0 |
| media_count |
Total number of media items which the tweet has [regardless of how many were returned]. For example 2 images, 1 thumbnail and 1 video -> That number will be 4 |
4 |
| mediaid | Internal id of photo/video | 1234561234561234561 |
| bitrate | Bitrate of crawled video objects | 832000 |
| tweetid | id of the related tweet | 1234567890123456789 |
| tweet_text | Text of tweet containing crawled media | example |
| crawlerfilename | Filename set by crawler plugin. Available for all items added via crawler. |
example.mp4 |
| type | Type of the added item. Only available for items processed via crawler. Possible values: video, photo, text |
photo, text, video |
| retweet | Boolean: true if that item is a retweet. False or null if it is a normal tweet. | true, false, null |
| is_pinned_tweet | Boolean: true if that item was pinned while it was crawled. | true, false, null |
| reply | Boolean: true if that item is a reply to another tweet. False or null if it is not. | true, false, null |
| crawlerfilename |
DEPRECATED: Full filename which is set in crawler. Only available for older items. |
somestring.mp4 |
| related_original_filename |
Original filename of item related to this item. This is typically only available for .txt files with tweet post content. |
somestring.mp4, somestring.jpg |
| user_id | Internal ID of the Twitter user | 123456 |
|
source_anything Example: source_user_id |
If the Tweet is a Retweet, some properties of the original Tweet can be accessed by using the same properties listed here with prefix ‘source_’. For example source_user_id gives you the user_id of the user who Tweeted the current Retweet. |
