Package crawlercommons.urlfrontier
Class Urlfrontier
- java.lang.Object
-
- crawlercommons.urlfrontier.Urlfrontier
-
public final class Urlfrontier extends Object
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static classUrlfrontier.AckMessageProtobuf typeurlfrontier.AckMessagestatic interfaceUrlfrontier.AckMessageOrBuilderstatic classUrlfrontier.ActiveProtobuf typeurlfrontier.Activestatic interfaceUrlfrontier.ActiveOrBuilderstatic classUrlfrontier.AnyCrawlIDProtobuf typeurlfrontier.AnyCrawlIDstatic interfaceUrlfrontier.AnyCrawlIDOrBuilderstatic classUrlfrontier.BlockQueueParams* Parameter message for BlockQueueUntil *static interfaceUrlfrontier.BlockQueueParamsOrBuilderstatic classUrlfrontier.BooleanProtobuf typeurlfrontier.Booleanstatic interfaceUrlfrontier.BooleanOrBuilderstatic classUrlfrontier.DeleteCrawlMessageProtobuf typeurlfrontier.DeleteCrawlMessagestatic interfaceUrlfrontier.DeleteCrawlMessageOrBuilderstatic classUrlfrontier.DiscoveredURLItem* URL discovered during the crawl, might already be known in the URL Frontier or not.static interfaceUrlfrontier.DiscoveredURLItemOrBuilderstatic classUrlfrontier.EmptyProtobuf typeurlfrontier.Emptystatic interfaceUrlfrontier.EmptyOrBuilderstatic classUrlfrontier.GetParams* Parameter message for GetURLs *static interfaceUrlfrontier.GetParamsOrBuilderstatic classUrlfrontier.KnownURLItem* URL which was already known in the frontier, was returned by GetURLs() and processed by the crawler.static interfaceUrlfrontier.KnownURLItemOrBuilderstatic classUrlfrontier.LocalProtobuf typeurlfrontier.Localstatic interfaceUrlfrontier.LocalOrBuilderstatic classUrlfrontier.LogLevelParams* Configuration of the log level for a particular package, e.g.static interfaceUrlfrontier.LogLevelParamsOrBuilderstatic classUrlfrontier.LongProtobuf typeurlfrontier.Longstatic interfaceUrlfrontier.LongOrBuilderstatic classUrlfrontier.PaginationProtobuf typeurlfrontier.Paginationstatic interfaceUrlfrontier.PaginationOrBuilderstatic classUrlfrontier.QueueDelayParams* Parameter message for SetDelay *static interfaceUrlfrontier.QueueDelayParamsOrBuilderstatic classUrlfrontier.QueueList* Returned by ListQueues *static interfaceUrlfrontier.QueueListOrBuilderstatic classUrlfrontier.QueueWithinCrawlParamsProtobuf typeurlfrontier.QueueWithinCrawlParamsstatic interfaceUrlfrontier.QueueWithinCrawlParamsOrBuilderstatic classUrlfrontier.Stats* Message returned by the GetStats methodstatic interfaceUrlfrontier.StatsOrBuilderstatic classUrlfrontier.StringListProtobuf typeurlfrontier.StringListstatic interfaceUrlfrontier.StringListOrBuilderstatic classUrlfrontier.URLInfoProtobuf typeurlfrontier.URLInfostatic interfaceUrlfrontier.URLInfoOrBuilderstatic classUrlfrontier.URLItem* Wrapper for a KnownURLItem or DiscoveredURLItem *static interfaceUrlfrontier.URLItemOrBuilder
-
Method Summary
All Methods Static Methods Concrete Methods Modifier and Type Method Description static com.google.protobuf.Descriptors.FileDescriptorgetDescriptor()static voidregisterAllExtensions(com.google.protobuf.ExtensionRegistry registry)static voidregisterAllExtensions(com.google.protobuf.ExtensionRegistryLite registry)
-
-
-
Method Detail
-
registerAllExtensions
public static void registerAllExtensions(com.google.protobuf.ExtensionRegistryLite registry)
-
registerAllExtensions
public static void registerAllExtensions(com.google.protobuf.ExtensionRegistry registry)
-
getDescriptor
public static com.google.protobuf.Descriptors.FileDescriptor getDescriptor()
-
-