|
twitter.com: Advanced features
Our twitter.com Plugins support some advanced features which will be explained here.
Special URL parameters which can be used as abort conditions for profile crawling
- maxitems -> Define how many tweets of a profile should be crawled at most
- max_date -> Only crawl items until end of day before this date
Usage example:
If you want to crawl twitter.com/exampleProfile and only want to crawl the first 50 items, add it like this:
twitter.com/exampleProfile?maxitems=50
Of course you can include both abort conditions at the same time like this:
twitter.com/exampleProfile?max_date=2022-01-15&maxitems=50
This will crawl up to 50 items or tweets until max posted date of 2022-01-14 11:59PM.
The abort condition which is reached first will abort the crawl process.
Special plugin properties that e.g. for custom filenames via Packagizer
| Property key |
Description |
Example |
| username |
Profile name of added profile to crawl / owner of added tweet. |
exampleusername |
| date |
Date when content was posted in form yyyy-MM-dd |
2022-01-17 |
| date_timestamp |
Timestamp in milliseconds of date when content was posted. |
1688670637000 |
| mediaindex |
Index of media in context of single tweet.
Useful when adding tweets containing multiple media items.
|
0 |
| media_count |
Total number of media items which the tweet has [regardless of how many were returned].
For example 2 images, 1 thumbnail and 1 video -> That number will be 4
|
4 |
| mediaid |
Internal id of photo/video |
1234561234561234561 |
| bitrate |
Bitrate of crawled video objects |
832000 |
| tweetid |
id of the related tweet |
1234567890123456789 |
| tweet_text |
Text of tweet containing crawled media |
example |
| crawlerfilename |
Filename set by crawler plugin.
Available for all items added via crawler. |
example.mp4 |
| type |
Type of the added item.
Only available for items processed via crawler.
Possible values: video, photo, text |
photo, text, video |
| retweet |
Boolean: true if that item is a retweet. False or null if it is a normal tweet. |
true, false, null |
| reply |
Boolean: true if that item is a reply to another tweet. False or null if it is not. |
true, false, null |
| crawlerfilename |
DEPRECATED: Full filename which is set in crawler.
Only available for older items.
|
somestring.mp4 |
| related_original_filename |
Original filename of item related to this item.
This is typically only available for .txt files with tweet post content.
|
somestring.mp4, somestring.jpg |
| 