Elassandra 6.2.3.12 fails to create mappingSpring Data Elastic Search with Nested Fields and mappingChanging elasticsearch mappingElasticsearch default mappingMapper for conflicts with existing mappingMapping text value via searchkick errorindex_not_found_exeception. elassandraElassandra multiple type mappingElasticSearch don't syncronise index with cassandra insertError when creating mapping in ElassandraGetting illegal_argument_exception when trying to create index with mapping
How to split a string by the third .(dot) delimiter
How can "life" insurance prevent the cheapening of death?
Which ping implementation is cygwin using?
Could the government trigger by-elections to regain a majority?
Is there a star over my head?
Dividing Divisive Divisors
Why is the the worst case for this function O(n^2)?
What are the advantages and disadvantages of Preprepints.org compared with arXiv?
Character theory and Quantum Chemistry
How would a village use its river that it shares with another village downstream?
Does the mana ability restriction of Pithing Needle refer to the cost or the effect of an activated ability?
How do I preserve the line ordering for two "equal" strings while sorting and ignoring the case?
How should we understand "unobscured by flying friends" in this context?
Can board a plane to Cameroon without a Cameroonian visa?
How do I politely hint customers to leave my store, without pretending to need leave store myself?
What causes this bloom with an old telephoto lens?
Is there any detail about ambulances in Star Wars?
Is English tonal for some words, like "permit"?
Where does the expression "triple-A" comes from?
How to progress with CPLEX/Gurobi
Procedure for traffic not in sight
Why didn't Thor use the All powerful spear instead of Stormbreaker?
Is it appropriate for a professor to require students to sign a non-disclosure agreement before being taught?
How was Carlo's plan supposed to work?
Elassandra 6.2.3.12 fails to create mapping
Spring Data Elastic Search with Nested Fields and mappingChanging elasticsearch mappingElasticsearch default mappingMapper for conflicts with existing mappingMapping text value via searchkick errorindex_not_found_exeception. elassandraElassandra multiple type mappingElasticSearch don't syncronise index with cassandra insertError when creating mapping in ElassandraGetting illegal_argument_exception when trying to create index with mapping
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;
I´m having trouble creating an index on elassandra 6.2.3.12
Affected table:
CREATE TABLE devices (
id uuid,
comm_nr text,
configuration map<text,text>,
customer text,
description text,
groups list<text>,
last_active_nanoseconds bigint,
location uuid,
notes text,
picture text,
status text,
tag text,
thumbnail text,
"type" text,
"users" list<text>,
PRIMARY KEY (id)
)
When I try to create a ES index for that table it fails with these errors in system.log
2019-03-26 21:58:43,974 INFO [elasticsearch[10.164.0.22][generic][T#4]] CassandraShardStateListener.java:59 afterIndexShardStarted shard [devices][0] started 2019-03-26 21:58:43,975 INFO [elasticsearch[10.164.0.22][generic][T#4]] ElasticSecondaryIndex.java:2545 startRebuildIfNeeded start building secondary iot_data.devices.elastic_devices_idx 2019-03-26 21:58:44,002 INFO [elasticsearch[10.164.0.22][generic][T#4]] SecondaryIndexManager.java:571 buildIndexesBlocking Submitting index build of elastic_devices_idx for data in BigTableReader(path='/var/lib/cassandra/data/iot_data/devices-c4a249f04ff611e9ba438dba5fe3507f/mc-1-big-Data.db') 2019-03-26 21:58:44,010 INFO [CompactionExecutor:74] ElasticSecondaryIndex.java:490 addField updating mapping="devices":"properties":"configuration":"type":"nested","cql_struct":"map","cql_collection":"singleton","properties":"size":"type":"keyword" 2019-03-26 21:58:44,046 INFO [elasticsearch[10.164.0.22][masterService#updateTask][T#1]] CassandraDiscovery.java:920 publish CQL SchemaChanges=[UPDATED TABLE iot_data.devices, UPDATED TABLE elastic_admin.metadata] 2019-03-26 21:59:14,041 INFO [elasticsearch[10.164.0.22][masterService#updateTask][T#1]] CassandraDiscovery.java:964 publish commit state [6d18bf5c-32df-4815-bf06-e565cc71ac9b/7] timeout with pending nodes=[10.164.0.226d18bf5c-32df-4815-bf06-e565cc71ac9b6d18bf5c-32df-4815-bf06-e565cc71ac9b10.164.0.2210.164.0.22:9300ALIVErack=rack1, dc=datacenter-prod-1] 2019-03-26 21:59:14,042 WARN [elasticsearch[10.164.0.22][masterService#updateTask][T#1]] MasterService.java:583 warnAboutSlowTaskIfNeeded cluster state update task [put-mapping[devices]] took [30s] above the warn threshold of 30s 2019-03-26 21:59:14,042 ERROR [CompactionExecutor:74] ElasticSecondaryIndex.java:499 addField error while updating mapping org.elasticsearch.ElasticsearchTimeoutException: blocking update timeout at org.elasticsearch.cluster.service.ClusterService$BlockingActionListener.waitForUpdate(ClusterService.java:640) at org.elasticsearch.cluster.service.ClusterService.blockingMappingUpdate(ClusterService.java:689) at org.elassandra.index.ElasticSecondaryIndex.addField(ElasticSecondaryIndex.java:492) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer$Rowcument.buildContext(ElasticSecondaryIndex.java:2192) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$SkinnyRowcumentIndexer$SkinnyRowcument.buildContext(ElasticSecondaryIndex.java:1738) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer$Rowcument.index(ElasticSecondaryIndex.java:2285) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer$Rowcument.index(ElasticSecondaryIndex.java:2262) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$SkinnyRowcumentIndexer$SkinnyRowcument.index(ElasticSecondaryIndex.java:1738) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer$Rowcument.write(ElasticSecondaryIndex.java:2245) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$SkinnyRowcumentIndexer$SkinnyRowcument.write(ElasticSecondaryIndex.java:1738) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$SkinnyRowcumentIndexer.update(ElasticSecondaryIndex.java:1779) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer.finish(ElasticSecondaryIndex.java:1962) at java.lang.Iterable.forEach(Iterable.java:75) at org.apache.cassandra.index.SecondaryIndexManager.indexPartition(SecondaryIndexManager.java:1067) at org.apache.cassandra.index.internal.CollatedViewIndexBuilder.build(CollatedViewIndexBuilder.java:139) at org.apache.cassandra.db.compaction.CompactionManager$14.run(CompactionManager.java:1637) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81) at java.lang.Thread.run(Thread.java:748) 2019-03-26 21:59:14,043 ERROR [CompactionExecutor:74] ElasticSecondaryIndex.java:516 addField submapper not found for nested field [size] in index [devices] 2019-03-26 21:59:14,044 INFO [CompactionExecutor:74] ElasticSecondaryIndex.java:490 addField updating mapping="devices":"properties":"configuration":"type":"nested","cql_struct":"map","cql_collection":"singleton","properties":"pressure":"type":"keyword" 2019-03-26 21:59:14,086 INFO [elasticsearch[10.164.0.22][masterService#updateTask][T#1]] CassandraDiscovery.java:920 publish CQL SchemaChanges=[UPDATED TABLE iot_data.devices, UPDATED TABLE elastic_admin.metadata] 2019-03-26 21:59:44,045 ERROR [CompactionExecutor:74] ElasticSecondaryIndex.java:499 addField error while updating mapping org.elasticsearch.ElasticsearchTimeoutException: blocking update timeout
I think the relevant part of the error is this:
ElasticSecondaryIndex.java:516 addField submapper not found for nested
field [size] in index [devices] 2019-03-26 21:59:14,044 INFO
[CompactionExecutor:74] ElasticSecondaryIndex.java:490 addField
updating
mapping="devices":"properties":"configuration":"type":"nested","cql_struct":"map","cql_collection":"singleton","properties":"pressure":"type":"keyword"
So obviosly it fails to find a correct submapper for the keys of the map. But why and how do I fix this - especially as the map can grow and contain new keywords?
This error continues then. From the logs I see that it complains about the "configuration" field of my device entity. Here is an example of an real entry for this field:
'datasource' : 'api', 'external_id' : '003011FADB4A', 'first_active_on' : '01-03-2019', 'pressure' : '12S', 'size' : '35'
When I add the mapping with "configuration" column ignored, there are no errors.
What am I doing wrong?
elasticsearch cassandra elassandra asked Mar 28 at 7:48
Alex TbkAlex Tbk
7401 gold badge8 silver badges27 bronze badges
add a comment |
I´m having trouble creating an index on elassandra 6.2.3.12
Affected table:
CREATE TABLE devices (
id uuid,
comm_nr text,
configuration map<text,text>,
customer text,
description text,
groups list<text>,
last_active_nanoseconds bigint,
location uuid,
notes text,
picture text,
status text,
tag text,
thumbnail text,
"type" text,
"users" list<text>,
PRIMARY KEY (id)
)
When I try to create a ES index for that table it fails with these errors in system.log
2019-03-26 21:58:43,974 INFO [elasticsearch[10.164.0.22][generic][T#4]] CassandraShardStateListener.java:59 afterIndexShardStarted shard [devices][0] started 2019-03-26 21:58:43,975 INFO [elasticsearch[10.164.0.22][generic][T#4]] ElasticSecondaryIndex.java:2545 startRebuildIfNeeded start building secondary iot_data.devices.elastic_devices_idx 2019-03-26 21:58:44,002 INFO [elasticsearch[10.164.0.22][generic][T#4]] SecondaryIndexManager.java:571 buildIndexesBlocking Submitting index build of elastic_devices_idx for data in BigTableReader(path='/var/lib/cassandra/data/iot_data/devices-c4a249f04ff611e9ba438dba5fe3507f/mc-1-big-Data.db') 2019-03-26 21:58:44,010 INFO [CompactionExecutor:74] ElasticSecondaryIndex.java:490 addField updating mapping="devices":"properties":"configuration":"type":"nested","cql_struct":"map","cql_collection":"singleton","properties":"size":"type":"keyword" 2019-03-26 21:58:44,046 INFO [elasticsearch[10.164.0.22][masterService#updateTask][T#1]] CassandraDiscovery.java:920 publish CQL SchemaChanges=[UPDATED TABLE iot_data.devices, UPDATED TABLE elastic_admin.metadata] 2019-03-26 21:59:14,041 INFO [elasticsearch[10.164.0.22][masterService#updateTask][T#1]] CassandraDiscovery.java:964 publish commit state [6d18bf5c-32df-4815-bf06-e565cc71ac9b/7] timeout with pending nodes=[10.164.0.226d18bf5c-32df-4815-bf06-e565cc71ac9b6d18bf5c-32df-4815-bf06-e565cc71ac9b10.164.0.2210.164.0.22:9300ALIVErack=rack1, dc=datacenter-prod-1] 2019-03-26 21:59:14,042 WARN [elasticsearch[10.164.0.22][masterService#updateTask][T#1]] MasterService.java:583 warnAboutSlowTaskIfNeeded cluster state update task [put-mapping[devices]] took [30s] above the warn threshold of 30s 2019-03-26 21:59:14,042 ERROR [CompactionExecutor:74] ElasticSecondaryIndex.java:499 addField error while updating mapping org.elasticsearch.ElasticsearchTimeoutException: blocking update timeout at org.elasticsearch.cluster.service.ClusterService$BlockingActionListener.waitForUpdate(ClusterService.java:640) at org.elasticsearch.cluster.service.ClusterService.blockingMappingUpdate(ClusterService.java:689) at org.elassandra.index.ElasticSecondaryIndex.addField(ElasticSecondaryIndex.java:492) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer$Rowcument.buildContext(ElasticSecondaryIndex.java:2192) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$SkinnyRowcumentIndexer$SkinnyRowcument.buildContext(ElasticSecondaryIndex.java:1738) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer$Rowcument.index(ElasticSecondaryIndex.java:2285) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer$Rowcument.index(ElasticSecondaryIndex.java:2262) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$SkinnyRowcumentIndexer$SkinnyRowcument.index(ElasticSecondaryIndex.java:1738) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer$Rowcument.write(ElasticSecondaryIndex.java:2245) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$SkinnyRowcumentIndexer$SkinnyRowcument.write(ElasticSecondaryIndex.java:1738) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$SkinnyRowcumentIndexer.update(ElasticSecondaryIndex.java:1779) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer.finish(ElasticSecondaryIndex.java:1962) at java.lang.Iterable.forEach(Iterable.java:75) at org.apache.cassandra.index.SecondaryIndexManager.indexPartition(SecondaryIndexManager.java:1067) at org.apache.cassandra.index.internal.CollatedViewIndexBuilder.build(CollatedViewIndexBuilder.java:139) at org.apache.cassandra.db.compaction.CompactionManager$14.run(CompactionManager.java:1637) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81) at java.lang.Thread.run(Thread.java:748) 2019-03-26 21:59:14,043 ERROR [CompactionExecutor:74] ElasticSecondaryIndex.java:516 addField submapper not found for nested field [size] in index [devices] 2019-03-26 21:59:14,044 INFO [CompactionExecutor:74] ElasticSecondaryIndex.java:490 addField updating mapping="devices":"properties":"configuration":"type":"nested","cql_struct":"map","cql_collection":"singleton","properties":"pressure":"type":"keyword" 2019-03-26 21:59:14,086 INFO [elasticsearch[10.164.0.22][masterService#updateTask][T#1]] CassandraDiscovery.java:920 publish CQL SchemaChanges=[UPDATED TABLE iot_data.devices, UPDATED TABLE elastic_admin.metadata] 2019-03-26 21:59:44,045 ERROR [CompactionExecutor:74] ElasticSecondaryIndex.java:499 addField error while updating mapping org.elasticsearch.ElasticsearchTimeoutException: blocking update timeout
I think the relevant part of the error is this:
ElasticSecondaryIndex.java:516 addField submapper not found for nested
field [size] in index [devices] 2019-03-26 21:59:14,044 INFO
[CompactionExecutor:74] ElasticSecondaryIndex.java:490 addField
updating
mapping="devices":"properties":"configuration":"type":"nested","cql_struct":"map","cql_collection":"singleton","properties":"pressure":"type":"keyword"
So obviosly it fails to find a correct submapper for the keys of the map. But why and how do I fix this - especially as the map can grow and contain new keywords?
This error continues then. From the logs I see that it complains about the "configuration" field of my device entity. Here is an example of an real entry for this field:
'datasource' : 'api', 'external_id' : '003011FADB4A', 'first_active_on' : '01-03-2019', 'pressure' : '12S', 'size' : '35'
When I add the mapping with "configuration" column ignored, there are no errors.
What am I doing wrong?
elasticsearch cassandra elassandra asked Mar 28 at 7:48
Alex TbkAlex Tbk
7401 gold badge8 silver badges27 bronze badges
add a comment |
I´m having trouble creating an index on elassandra 6.2.3.12
Affected table:
CREATE TABLE devices (
id uuid,
comm_nr text,
configuration map<text,text>,
customer text,
description text,
groups list<text>,
last_active_nanoseconds bigint,
location uuid,
notes text,
picture text,
status text,
tag text,
thumbnail text,
"type" text,
"users" list<text>,
PRIMARY KEY (id)
)
When I try to create a ES index for that table it fails with these errors in system.log
2019-03-26 21:58:43,974 INFO [elasticsearch[10.164.0.22][generic][T#4]] CassandraShardStateListener.java:59 afterIndexShardStarted shard [devices][0] started 2019-03-26 21:58:43,975 INFO [elasticsearch[10.164.0.22][generic][T#4]] ElasticSecondaryIndex.java:2545 startRebuildIfNeeded start building secondary iot_data.devices.elastic_devices_idx 2019-03-26 21:58:44,002 INFO [elasticsearch[10.164.0.22][generic][T#4]] SecondaryIndexManager.java:571 buildIndexesBlocking Submitting index build of elastic_devices_idx for data in BigTableReader(path='/var/lib/cassandra/data/iot_data/devices-c4a249f04ff611e9ba438dba5fe3507f/mc-1-big-Data.db') 2019-03-26 21:58:44,010 INFO [CompactionExecutor:74] ElasticSecondaryIndex.java:490 addField updating mapping="devices":"properties":"configuration":"type":"nested","cql_struct":"map","cql_collection":"singleton","properties":"size":"type":"keyword" 2019-03-26 21:58:44,046 INFO [elasticsearch[10.164.0.22][masterService#updateTask][T#1]] CassandraDiscovery.java:920 publish CQL SchemaChanges=[UPDATED TABLE iot_data.devices, UPDATED TABLE elastic_admin.metadata] 2019-03-26 21:59:14,041 INFO [elasticsearch[10.164.0.22][masterService#updateTask][T#1]] CassandraDiscovery.java:964 publish commit state [6d18bf5c-32df-4815-bf06-e565cc71ac9b/7] timeout with pending nodes=[10.164.0.226d18bf5c-32df-4815-bf06-e565cc71ac9b6d18bf5c-32df-4815-bf06-e565cc71ac9b10.164.0.2210.164.0.22:9300ALIVErack=rack1, dc=datacenter-prod-1] 2019-03-26 21:59:14,042 WARN [elasticsearch[10.164.0.22][masterService#updateTask][T#1]] MasterService.java:583 warnAboutSlowTaskIfNeeded cluster state update task [put-mapping[devices]] took [30s] above the warn threshold of 30s 2019-03-26 21:59:14,042 ERROR [CompactionExecutor:74] ElasticSecondaryIndex.java:499 addField error while updating mapping org.elasticsearch.ElasticsearchTimeoutException: blocking update timeout at org.elasticsearch.cluster.service.ClusterService$BlockingActionListener.waitForUpdate(ClusterService.java:640) at org.elasticsearch.cluster.service.ClusterService.blockingMappingUpdate(ClusterService.java:689) at org.elassandra.index.ElasticSecondaryIndex.addField(ElasticSecondaryIndex.java:492) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer$Rowcument.buildContext(ElasticSecondaryIndex.java:2192) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$SkinnyRowcumentIndexer$SkinnyRowcument.buildContext(ElasticSecondaryIndex.java:1738) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer$Rowcument.index(ElasticSecondaryIndex.java:2285) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer$Rowcument.index(ElasticSecondaryIndex.java:2262) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$SkinnyRowcumentIndexer$SkinnyRowcument.index(ElasticSecondaryIndex.java:1738) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer$Rowcument.write(ElasticSecondaryIndex.java:2245) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$SkinnyRowcumentIndexer$SkinnyRowcument.write(ElasticSecondaryIndex.java:1738) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$SkinnyRowcumentIndexer.update(ElasticSecondaryIndex.java:1779) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer.finish(ElasticSecondaryIndex.java:1962) at java.lang.Iterable.forEach(Iterable.java:75) at org.apache.cassandra.index.SecondaryIndexManager.indexPartition(SecondaryIndexManager.java:1067) at org.apache.cassandra.index.internal.CollatedViewIndexBuilder.build(CollatedViewIndexBuilder.java:139) at org.apache.cassandra.db.compaction.CompactionManager$14.run(CompactionManager.java:1637) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81) at java.lang.Thread.run(Thread.java:748) 2019-03-26 21:59:14,043 ERROR [CompactionExecutor:74] ElasticSecondaryIndex.java:516 addField submapper not found for nested field [size] in index [devices] 2019-03-26 21:59:14,044 INFO [CompactionExecutor:74] ElasticSecondaryIndex.java:490 addField updating mapping="devices":"properties":"configuration":"type":"nested","cql_struct":"map","cql_collection":"singleton","properties":"pressure":"type":"keyword" 2019-03-26 21:59:14,086 INFO [elasticsearch[10.164.0.22][masterService#updateTask][T#1]] CassandraDiscovery.java:920 publish CQL SchemaChanges=[UPDATED TABLE iot_data.devices, UPDATED TABLE elastic_admin.metadata] 2019-03-26 21:59:44,045 ERROR [CompactionExecutor:74] ElasticSecondaryIndex.java:499 addField error while updating mapping org.elasticsearch.ElasticsearchTimeoutException: blocking update timeout
I think the relevant part of the error is this:
ElasticSecondaryIndex.java:516 addField submapper not found for nested
field [size] in index [devices] 2019-03-26 21:59:14,044 INFO
[CompactionExecutor:74] ElasticSecondaryIndex.java:490 addField
updating
mapping="devices":"properties":"configuration":"type":"nested","cql_struct":"map","cql_collection":"singleton","properties":"pressure":"type":"keyword"
So obviosly it fails to find a correct submapper for the keys of the map. But why and how do I fix this - especially as the map can grow and contain new keywords?
This error continues then. From the logs I see that it complains about the "configuration" field of my device entity. Here is an example of an real entry for this field:
'datasource' : 'api', 'external_id' : '003011FADB4A', 'first_active_on' : '01-03-2019', 'pressure' : '12S', 'size' : '35'
When I add the mapping with "configuration" column ignored, there are no errors.
What am I doing wrong?
elasticsearch cassandra elassandra asked Mar 28 at 7:48
Alex TbkAlex Tbk
7401 gold badge8 silver badges27 bronze badges
I´m having trouble creating an index on elassandra 6.2.3.12
Affected table:
CREATE TABLE devices (
id uuid,
comm_nr text,
configuration map<text,text>,
customer text,
description text,
groups list<text>,
last_active_nanoseconds bigint,
location uuid,
notes text,
picture text,
status text,
tag text,
thumbnail text,
"type" text,
"users" list<text>,
PRIMARY KEY (id)
)
When I try to create a ES index for that table it fails with these errors in system.log
2019-03-26 21:58:43,974 INFO [elasticsearch[10.164.0.22][generic][T#4]] CassandraShardStateListener.java:59 afterIndexShardStarted shard [devices][0] started 2019-03-26 21:58:43,975 INFO [elasticsearch[10.164.0.22][generic][T#4]] ElasticSecondaryIndex.java:2545 startRebuildIfNeeded start building secondary iot_data.devices.elastic_devices_idx 2019-03-26 21:58:44,002 INFO [elasticsearch[10.164.0.22][generic][T#4]] SecondaryIndexManager.java:571 buildIndexesBlocking Submitting index build of elastic_devices_idx for data in BigTableReader(path='/var/lib/cassandra/data/iot_data/devices-c4a249f04ff611e9ba438dba5fe3507f/mc-1-big-Data.db') 2019-03-26 21:58:44,010 INFO [CompactionExecutor:74] ElasticSecondaryIndex.java:490 addField updating mapping="devices":"properties":"configuration":"type":"nested","cql_struct":"map","cql_collection":"singleton","properties":"size":"type":"keyword" 2019-03-26 21:58:44,046 INFO [elasticsearch[10.164.0.22][masterService#updateTask][T#1]] CassandraDiscovery.java:920 publish CQL SchemaChanges=[UPDATED TABLE iot_data.devices, UPDATED TABLE elastic_admin.metadata] 2019-03-26 21:59:14,041 INFO [elasticsearch[10.164.0.22][masterService#updateTask][T#1]] CassandraDiscovery.java:964 publish commit state [6d18bf5c-32df-4815-bf06-e565cc71ac9b/7] timeout with pending nodes=[10.164.0.226d18bf5c-32df-4815-bf06-e565cc71ac9b6d18bf5c-32df-4815-bf06-e565cc71ac9b10.164.0.2210.164.0.22:9300ALIVErack=rack1, dc=datacenter-prod-1] 2019-03-26 21:59:14,042 WARN [elasticsearch[10.164.0.22][masterService#updateTask][T#1]] MasterService.java:583 warnAboutSlowTaskIfNeeded cluster state update task [put-mapping[devices]] took [30s] above the warn threshold of 30s 2019-03-26 21:59:14,042 ERROR [CompactionExecutor:74] ElasticSecondaryIndex.java:499 addField error while updating mapping org.elasticsearch.ElasticsearchTimeoutException: blocking update timeout at org.elasticsearch.cluster.service.ClusterService$BlockingActionListener.waitForUpdate(ClusterService.java:640) at org.elasticsearch.cluster.service.ClusterService.blockingMappingUpdate(ClusterService.java:689) at org.elassandra.index.ElasticSecondaryIndex.addField(ElasticSecondaryIndex.java:492) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer$Rowcument.buildContext(ElasticSecondaryIndex.java:2192) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$SkinnyRowcumentIndexer$SkinnyRowcument.buildContext(ElasticSecondaryIndex.java:1738) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer$Rowcument.index(ElasticSecondaryIndex.java:2285) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer$Rowcument.index(ElasticSecondaryIndex.java:2262) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$SkinnyRowcumentIndexer$SkinnyRowcument.index(ElasticSecondaryIndex.java:1738) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer$Rowcument.write(ElasticSecondaryIndex.java:2245) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$SkinnyRowcumentIndexer$SkinnyRowcument.write(ElasticSecondaryIndex.java:1738) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$SkinnyRowcumentIndexer.update(ElasticSecondaryIndex.java:1779) at org.elassandra.index.ElasticSecondaryIndex$ImmutableMappingInfo$RowcumentIndexer.finish(ElasticSecondaryIndex.java:1962) at java.lang.Iterable.forEach(Iterable.java:75) at org.apache.cassandra.index.SecondaryIndexManager.indexPartition(SecondaryIndexManager.java:1067) at org.apache.cassandra.index.internal.CollatedViewIndexBuilder.build(CollatedViewIndexBuilder.java:139) at org.apache.cassandra.db.compaction.CompactionManager$14.run(CompactionManager.java:1637) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81) at java.lang.Thread.run(Thread.java:748) 2019-03-26 21:59:14,043 ERROR [CompactionExecutor:74] ElasticSecondaryIndex.java:516 addField submapper not found for nested field [size] in index [devices] 2019-03-26 21:59:14,044 INFO [CompactionExecutor:74] ElasticSecondaryIndex.java:490 addField updating mapping="devices":"properties":"configuration":"type":"nested","cql_struct":"map","cql_collection":"singleton","properties":"pressure":"type":"keyword" 2019-03-26 21:59:14,086 INFO [elasticsearch[10.164.0.22][masterService#updateTask][T#1]] CassandraDiscovery.java:920 publish CQL SchemaChanges=[UPDATED TABLE iot_data.devices, UPDATED TABLE elastic_admin.metadata] 2019-03-26 21:59:44,045 ERROR [CompactionExecutor:74] ElasticSecondaryIndex.java:499 addField error while updating mapping org.elasticsearch.ElasticsearchTimeoutException: blocking update timeout
I think the relevant part of the error is this:
ElasticSecondaryIndex.java:516 addField submapper not found for nested
field [size] in index [devices] 2019-03-26 21:59:14,044 INFO
[CompactionExecutor:74] ElasticSecondaryIndex.java:490 addField
updating
mapping="devices":"properties":"configuration":"type":"nested","cql_struct":"map","cql_collection":"singleton","properties":"pressure":"type":"keyword"
So obviosly it fails to find a correct submapper for the keys of the map. But why and how do I fix this - especially as the map can grow and contain new keywords?
This error continues then. From the logs I see that it complains about the "configuration" field of my device entity. Here is an example of an real entry for this field:
'datasource' : 'api', 'external_id' : '003011FADB4A', 'first_active_on' : '01-03-2019', 'pressure' : '12S', 'size' : '35'
When I add the mapping with "configuration" column ignored, there are no errors.
What am I doing wrong?
elasticsearch cassandra elassandra elasticsearch cassandra elassandra asked Mar 28 at 7:48
Alex TbkAlex Tbk
7401 gold badge8 silver badges27 bronze badges
asked Mar 28 at 7:48
Alex TbkAlex Tbk
7401 gold badge8 silver badges27 bronze badges
edited Mar 28 at 7:57
Alex Tbk
asked Mar 28 at 7:48
Alex TbkAlex Tbk
7401 gold badge8 silver badges27 bronze badges
asked Mar 28 at 7:48
Alex TbkAlex Tbk
7401 gold badge8 silver badges27 bronze badges
asked Mar 28 at 7:48
Alex TbkAlex Tbk
7401 gold badge8 silver badges27 bronze badges
7401 gold badge8 silver badges27 bronze badges
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/4.0/"u003ecc by-sa 4.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55392494%2felassandra-6-2-3-12-fails-to-create-mapping%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Is this question similar to what you get asked at work? Learn more about asking and sharing private information with your coworkers using Stack Overflow for Teams.
Is this question similar to what you get asked at work? Learn more about asking and sharing private information with your coworkers using Stack Overflow for Teams.
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55392494%2felassandra-6-2-3-12-fails-to-create-mapping%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
