Knowledgebase:
twitter.com: Advanced features
Posted by pspzockerscene psp, Last modified by pspzockerscene psp on 21 March 2022 01:41 PM

twitter.com: Advanced features

Our twitter.com Plugins support some advanced features which will be explained here.


Special URL parameters as abort conditions for profile crawling

  • maxitems -> Define how many tweets of a profile should be crawled at most
  • max_date -> Only crawl items until end of day before this date

Usage example:
If you want to crawl twitter.com/exampleProfile and only want to crawl the first 50 items, add it like this:
twitter.com/exampleProfile?maxitems=50

Of course you can include both abort conditions at the same time like this:
twitter.com/exampleProfile?max_date=2022-01-15&maxitems=50
This will crawl up to 50 items or tweets until max posted date of 2022-01-14 11:59PM.
The abort condition which is reached first will abort the crawl process.


Special plugin properties that e.g. for custom filenames via Packagizer

Property key Description Example
username Profile name of added profile to crawl exampleusername
date Date when content was posted in form yyyy-MM-dd 2022-01-17
mediaindex

Index of media in context of single tweet.

Useful when adding tweets containing multiple media items.

0
mediaid Internal id of photo/video 1234561234561234561
bitrate Bitrate of crawled video objects 832000
tweet_text Text of tweet containing crawled media example
crawlerfilename Filename set by crawler plugin.
Available for all items added via crawler.
example.mp4
type Type of the added item.
Only available for items processed via crawler.
Possible values: video, photo, text
video