|
twitter.com: Advanced features
Our twitter.com Plugins support some advanced features which will be explained here.
Special URL parameters as abort conditions for profile crawling
- maxitems -> Define how many tweets of a profile should be crawled at most
- max_date -> Only crawl items until end of day before this date
Usage example:
If you want to crawl twitter.com/exampleProfile and only want to crawl the first 50 items, add it like this:
twitter.com/exampleProfile?maxitems=50
Of course you can include both abort conditions at the same time like this:
twitter.com/exampleProfile?max_date=2022-01-15&maxitems=50
This will crawl up to 50 items or tweets until max posted date of 2022-01-14 11:59PM.
The abort condition which is reached first will abort the crawl process.
Special plugin properties that e.g. for custom filenames via Packagizer
| Property key |
Description |
Example |
| username |
Profile name of added profile to crawl |
exampleusername |
| date |
Date when content was posted in form yyyy-MM-dd |
2022-01-17 |
| mediaindex |
Index of media in context of single tweet.
Useful when adding tweets containing multiple media items.
|
0 |
| mediaid |
Internal id of photo/video |
1234561234561234561 |
| bitrate |
Bitrate of crawled video objects |
832000 |
| tweet_text |
Text of tweet containing crawled media |
example |
| crawlerfilename |
Filename set by crawler plugin.
Available for all items added via crawler. |
example.mp4 |
| type |
Type of the added item.
Only available for items processed via crawler.
Possible values: video, photo, text |
video |
| 