Package org.elasticsearch.hadoop.cfg
Class Settings
java.lang.Object
org.elasticsearch.hadoop.cfg.Settings
- Direct Known Subclasses:
CompositeSettings,FilteredSettings,HadoopSettings,PropertiesSettings,SparkSettings
Holder class containing the various configuration bits used by ElasticSearch Hadoop. Handles internally the fall back to defaults when looking for undefined, optional settings.
-
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionabstract Propertiesabstract Settingscopy()excludeFilter(String prefix) booleanbooleanintintintintlongorg.elasticsearch.hadoop.util.ClusterInfoGet the internal cluster name and version or null if not present in the settingsorg.elasticsearch.hadoop.util.ClusterInfoGet the internal cluster name and version or throw anIllegalArgumentExceptionif not presentorg.elasticsearch.hadoop.util.ClusterInfoDeprecated.This is a dangerous method to use, because it assumes that you care about which cluster you are working with, but the info you receive from this call may not be accurate, and thus, cannot be trusted to let you make accurate decisions about the ES cluster you are speaking with.booleanbooleanorg.elasticsearch.hadoop.util.unit.TimeValueintlongbooleanbooleanbooleanbooleanorg.elasticsearch.hadoop.util.EsMajorVersionDeprecated.This is kind of a dangerous method to use, because it assumes that you care about which version you are working with, but the version you receive from this call may not be accurate, and thus, cannot be trusted to let you make accurate decisions about the version of ES you are speaking with.org.elasticsearch.hadoop.util.EsMajorVersionGet the internal version or throw anIllegalArgumentExceptionif not presentbooleanbooleanDeprecated.booleanbooleanDeprecated.intDeprecated.intDeprecated.intbooleanbooleanbooleanbooleanDeprecated.Deprecated.getNodes()booleanbooleanbooleanbooleanbooleanbooleanbooleanintgetPort()abstract StringgetProperty(String name) getProperty(String name, String defaultValue) getQuery()booleanbooleanbooleanbooleanprotected StringlonglonglonggetSettingsView(String name) org.elasticsearch.hadoop.util.unit.TimeValueintbooleanbooleanbooleanbooleanbooleanabstract InputStreamloadResource(String location) merge(Properties properties) save()Deprecated.setInternalClusterInfo(org.elasticsearch.hadoop.util.ClusterInfo clusterInfo) setInternalVersion(org.elasticsearch.hadoop.util.EsMajorVersion version) Deprecated.prefer to use Settings#setInternalClusterInfosetMaxDocsPerPartition(int size) setOpaqueId(String opaqueId) setPort(int port) abstract voidsetProperty(String name, String value) setResourceRead(String index) setResourceWrite(String index) setUserAgent(String userAgent)
-
Constructor Details
-
Settings
public Settings()
-
-
Method Details
-
getInternalVersionOrThrow
public org.elasticsearch.hadoop.util.EsMajorVersion getInternalVersionOrThrow()Get the internal version or throw anIllegalArgumentExceptionif not present- Returns:
- The
EsMajorVersionextracted from the properties
-
getInternalVersionOrLatest
Deprecated.This is kind of a dangerous method to use, because it assumes that you care about which version you are working with, but the version you receive from this call may not be accurate, and thus, cannot be trusted to let you make accurate decisions about the version of ES you are speaking with. Prefer to use thegetInternalVersionOrThrow()instead.Get the internal version orEsMajorVersion.LATESTif not present- Returns:
- The
EsMajorVersionextracted from the properties orEsMajorVersion.LATESTif not present
-
getClusterInfoOrThrow
public org.elasticsearch.hadoop.util.ClusterInfo getClusterInfoOrThrow()Get the internal cluster name and version or throw anIllegalArgumentExceptionif not present- Returns:
- the
ClusterInfoextracted from the properties
-
getClusterInfoOrNull
public org.elasticsearch.hadoop.util.ClusterInfo getClusterInfoOrNull()Get the internal cluster name and version or null if not present in the settings- Returns:
- the
ClusterInfoextracted from the properties or null if not present
-
getClusterInfoOrUnnamedLatest
Deprecated.This is a dangerous method to use, because it assumes that you care about which cluster you are working with, but the info you receive from this call may not be accurate, and thus, cannot be trusted to let you make accurate decisions about the ES cluster you are speaking with. Prefer to use thegetClusterInfoOrThrow()instead.Get the internal cluster name and version or throw anIllegalArgumentExceptionif not present- Returns:
- the
ClusterInfoextracted from the properties
-
getNodes
-
getPort
public int getPort() -
getNodesDiscovery
public boolean getNodesDiscovery() -
getShardPreference
-
getNodesPathPrefix
-
getNodesDataOnly
public boolean getNodesDataOnly() -
getNodesIngestOnly
public boolean getNodesIngestOnly() -
getNodesClientOnly
public boolean getNodesClientOnly() -
getNodesWANOnly
public boolean getNodesWANOnly() -
getHttpTimeout
public long getHttpTimeout() -
getHttpRetries
public int getHttpRetries() -
getBatchSizeInBytes
public int getBatchSizeInBytes() -
getBatchSizeInEntries
public int getBatchSizeInEntries() -
getBatchWriteRetryCount
public int getBatchWriteRetryCount() -
getBatchWriteRetryLimit
public int getBatchWriteRetryLimit() -
getBatchWriteRetryWait
public long getBatchWriteRetryWait() -
getBatchWriteRetryPolicy
-
getBatchRefreshAfterWrite
public boolean getBatchRefreshAfterWrite() -
getBatchFlushManual
public boolean getBatchFlushManual() -
getScrollKeepAlive
public long getScrollKeepAlive() -
getScrollSize
public long getScrollSize() -
getScrollLimit
public long getScrollLimit() -
getScrollFields
-
getExcludeSource
public boolean getExcludeSource() -
getSerializerValueWriterClassName
-
getSerializerBytesConverterClassName
-
getSerializerValueReaderClassName
-
getIndexAutoCreate
public boolean getIndexAutoCreate() -
getIndexReadMissingAsEmpty
public boolean getIndexReadMissingAsEmpty() -
getIndexReadAllowRedStatus
public boolean getIndexReadAllowRedStatus() -
getInputAsJson
public boolean getInputAsJson() -
getOutputAsJson
public boolean getOutputAsJson() -
getOperation
-
getMappingId
-
getMappingParent
-
getMappingJoin
-
getMappingVersion
-
hasMappingVersionType
public boolean hasMappingVersionType() -
getMappingVersionType
-
getMappingRouting
-
getMappingTtl
-
getMappingTimestamp
-
getMappingDefaultClassExtractor
-
getMappingMetadataExtractorClassName
-
getMappingIdExtractorClassName
-
getMappingParentExtractorClassName
-
getMappingJoinExtractorClassName
-
getMappingVersionExtractorClassName
-
getMappingRoutingExtractorClassName
-
getMappingTtlExtractorClassName
-
getMappingTimestampExtractorClassName
-
getMappingIndexExtractorClassName
-
getMappingIndexFormatterClassName
-
getMappingParamsExtractorClassName
-
getMappingConstantAutoQuote
public boolean getMappingConstantAutoQuote() -
getMappingDateRich
public boolean getMappingDateRich() -
getMappingIncludes
-
getMappingExcludes
-
getIngestPipeline
-
getUpdateRetryOnConflict
public int getUpdateRetryOnConflict() -
getUpdateScript
-
getUpdateScriptInline
-
getUpdateScriptUpsert
-
getUpdateScriptFile
-
getUpdateScriptStored
-
getUpdateScriptLang
-
getUpdateScriptParams
-
getUpdateScriptParamsJson
-
hasUpdateScript
public boolean hasUpdateScript() -
hasUpdateScriptParams
public boolean hasUpdateScriptParams() -
hasUpdateScriptParamsJson
public boolean hasUpdateScriptParamsJson() -
hasScriptUpsert
public boolean hasScriptUpsert() -
getReadFieldEmptyAsNull
public boolean getReadFieldEmptyAsNull() -
getReadFieldExistanceValidation
-
getReadFieldInclude
-
getReadFieldExclude
-
getReadFieldAsArrayInclude
-
getReadFieldAsArrayExclude
-
getReadSourceFilter
-
getHeartBeatLead
public org.elasticsearch.hadoop.util.unit.TimeValue getHeartBeatLead() -
getTransportPoolingExpirationTimeout
public org.elasticsearch.hadoop.util.unit.TimeValue getTransportPoolingExpirationTimeout() -
getNetworkSSLEnabled
public boolean getNetworkSSLEnabled() -
getNetworkSSLKeyStoreLocation
-
getNetworkSSLProtocol
-
getNetworkSSLKeyStoreType
-
getNetworkSSLKeyStorePass
Deprecated. -
getNetworkSSLTrustStoreLocation
-
getNetworkSSLTrustStorePass
Deprecated. -
getNetworkSSLAcceptSelfSignedCert
public boolean getNetworkSSLAcceptSelfSignedCert() -
getNetworkHttpAuthUser
-
getNetworkHttpAuthPass
Deprecated. -
getNetworkSpnegoAuthElasticsearchPrincipal
-
getNetworkSpnegoAuthMutual
public boolean getNetworkSpnegoAuthMutual() -
getNetworkProxyHttpHost
-
getNetworkProxyHttpPort
public int getNetworkProxyHttpPort() -
getNetworkProxyHttpUser
-
getNetworkProxyHttpPass
Deprecated. -
getNetworkHttpUseSystemProperties
public boolean getNetworkHttpUseSystemProperties() -
getNetworkProxyHttpsHost
-
getNetworkProxyHttpsPort
public int getNetworkProxyHttpsPort() -
getNetworkProxyHttpsUser
-
getNetworkProxyHttpsPass
Deprecated. -
getNetworkHttpsUseSystemProperties
public boolean getNetworkHttpsUseSystemProperties() -
getNetworkProxySocksHost
-
getNetworkProxySocksPort
public int getNetworkProxySocksPort() -
getNetworkProxySocksUser
-
getNetworkProxySocksPass
Deprecated. -
getNetworkSocksUseSystemProperties
public boolean getNetworkSocksUseSystemProperties() -
getNodesResolveHostnames
public boolean getNodesResolveHostnames() -
setInternalClusterInfo
-
setInternalVersion
@Deprecated public Settings setInternalVersion(org.elasticsearch.hadoop.util.EsMajorVersion version) Deprecated.prefer to use Settings#setInternalClusterInfo -
setNodes
-
setHosts
Deprecated. -
setPort
-
setResourceRead
-
setResourceWrite
-
setQuery
-
setMaxDocsPerPartition
-
getResource
-
getResourceRead
-
getResourceWrite
-
getQuery
-
getMaxDocsPerPartition
-
getReadMetadata
public boolean getReadMetadata() -
getReadMetadataField
-
getReadMetadataVersion
public boolean getReadMetadataVersion() -
getReadMappingMissingFieldsIgnore
public boolean getReadMappingMissingFieldsIgnore() -
getDataFrameWriteNullValues
public boolean getDataFrameWriteNullValues() -
getSecurityAuthenticationMethod
-
getSecurityUserProviderClass
-
loadResource
-
copy
-
getProperty
-
getProperty
-
setProperty
-
getSettingsView
-
excludeFilter
-
merge
-
merge
-
load
-
save
-
asProperties
-
setOpaqueId
-
getOpaqueId
-
setUserAgent
-