twitter.com: Advanced features
Our twitter.com Plugins support some advanced features which will be explained here.
Special URL parameters which can be used as abort conditions for profile crawling
- maxitems -> Define how many tweets of a profile should be crawled at most
- max_date -> Only crawl items until end of day before this date
If you want to crawl twitter.com/exampleProfile and only want to crawl the first 50 items, add it like this:
Of course you can include both abort conditions at the same time like this:
This will crawl up to 50 items or tweets until max posted date of 2022-01-14 11:59PM.
The abort condition which is reached first will abort the crawl process.
Special plugin properties that e.g. for custom filenames via Packagizer
||Profile name of added profile to crawl / owner of added tweet.
||Date when content was posted in form yyyy-MM-dd
||Timestamp in milliseconds of date when content was posted.
Index of media in context of single tweet.
Useful when adding tweets containing multiple media items.
Total number of media items which the tweet has [regardless of how many were returned].
For example 2 images, 1 thumbnail and 1 video -> That number will be 4
||Internal id of photo/video
||Bitrate of crawled video objects
||id of the related tweet
||Text of tweet containing crawled media
||Filename set by crawler plugin.
Available for all items added via crawler.
||Type of the added item.
Only available for items processed via crawler.
Possible values: video, photo, text
|photo, text, video
||Boolean: true if that item is a retweet. False or null if it is a normal tweet.
||true, false, null
||Boolean: true if that item is a reply to another tweet. False or null if it is not.
||true, false, null
DEPRECATED: Full filename which is set in crawler.
Only available for older items.
Original filename of item related to this item.
This is typically only available for .txt files with tweet post content.