crawlercommons.urlfrontier

Interface Urlfrontier.URLInfoOrBuilder

All Superinterfaces:

com.google.protobuf.MessageLiteOrBuilder, com.google.protobuf.MessageOrBuilder

All Known Implementing Classes:

Urlfrontier.URLInfo, Urlfrontier.URLInfo.Builder

Enclosing class:

Urlfrontier

public static interface Urlfrontier.URLInfoOrBuilder
extends com.google.protobuf.MessageOrBuilder

Method Summary

Modifier and Type	Method and Description
boolean	containsMetadata(java.lang.String key) Arbitrary key / values stored alongside the URL.
java.lang.String	getKey() The key is used to put the URLs into queues, the value can be anything set by the client but would typically be the hostname, domain name or IP or the URL.
com.google.protobuf.ByteString	getKeyBytes() The key is used to put the URLs into queues, the value can be anything set by the client but would typically be the hostname, domain name or IP or the URL.
java.util.Map<java.lang.String,Urlfrontier.StringList>	getMetadata() Deprecated.
int	getMetadataCount() Arbitrary key / values stored alongside the URL.
java.util.Map<java.lang.String,Urlfrontier.StringList>	getMetadataMap() Arbitrary key / values stored alongside the URL.
Urlfrontier.StringList	getMetadataOrDefault(java.lang.String key, Urlfrontier.StringList defaultValue) Arbitrary key / values stored alongside the URL.
Urlfrontier.StringList	getMetadataOrThrow(java.lang.String key) Arbitrary key / values stored alongside the URL.
java.lang.String	getUrl() URL *
com.google.protobuf.ByteString	getUrlBytes() URL *

Methods inherited from interface com.google.protobuf.MessageOrBuilder

findInitializationErrors, getAllFields, getDefaultInstanceForType, getDescriptorForType, getField, getInitializationErrorString, getOneofFieldDescriptor, getRepeatedField, getRepeatedFieldCount, getUnknownFields, hasField, hasOneof

Methods inherited from interface com.google.protobuf.MessageLiteOrBuilder

isInitialized

Method Detail

getUrl

java.lang.String getUrl()

 URL *
 

string url = 1;

Returns:

The url.

getUrlBytes

com.google.protobuf.ByteString getUrlBytes()

 URL *
 

string url = 1;

Returns:

The bytes for url.

getKey

java.lang.String getKey()

 The key is used to put the URLs into queues, the value can be anything set by the client but would typically be the hostname,
domain name or IP or the URL. If not set, the service will use a sensible default like hostname.
 

string key = 2;

Returns:

The key.

getKeyBytes

com.google.protobuf.ByteString getKeyBytes()

 The key is used to put the URLs into queues, the value can be anything set by the client but would typically be the hostname,
domain name or IP or the URL. If not set, the service will use a sensible default like hostname.
 

string key = 2;

Returns:

The bytes for key.

getMetadataCount

int getMetadataCount()

 
Arbitrary key / values stored alongside the URL. Can be anything needed by the crawler like http status, source URL etc...
 

map<string, .urlfrontier.StringList> metadata = 3;

containsMetadata

boolean containsMetadata(java.lang.String key)

 
Arbitrary key / values stored alongside the URL. Can be anything needed by the crawler like http status, source URL etc...
 

map<string, .urlfrontier.StringList> metadata = 3;

getMetadata

@Deprecated
java.util.Map<java.lang.String,Urlfrontier.StringList> getMetadata()

Deprecated.

Use getMetadataMap() instead.

getMetadataMap

java.util.Map<java.lang.String,Urlfrontier.StringList> getMetadataMap()

 
Arbitrary key / values stored alongside the URL. Can be anything needed by the crawler like http status, source URL etc...
 

map<string, .urlfrontier.StringList> metadata = 3;

getMetadataOrDefault

Urlfrontier.StringList getMetadataOrDefault(java.lang.String key,
                                            Urlfrontier.StringList defaultValue)

 
Arbitrary key / values stored alongside the URL. Can be anything needed by the crawler like http status, source URL etc...
 

map<string, .urlfrontier.StringList> metadata = 3;

getMetadataOrThrow

Urlfrontier.StringList getMetadataOrThrow(java.lang.String key)

 
Arbitrary key / values stored alongside the URL. Can be anything needed by the crawler like http status, source URL etc...
 

map<string, .urlfrontier.StringList> metadata = 3;