Column type issue when transferring bulk data between MySQL to Hive through SqoopShould I use the datetime or timestamp data type in MySQL?Facing issue for the below command in sqoopsqoop to transfer data to HDFS from Teradatasqoop to mysql importing issuesqoop - connect to oracle and import data to HDFS in IBM BigInsightsSQOOP Import Fails, File Not Found ExceptionSqoop import error message ERROR tool.ImportTool: Import failed: ENOENT: No such file or directory Optionssqoop error : Direct import is not compatible with HCatalog operationssqoop incremental append last modified

Existence of infinite set of positive integers s.t sum of reciprocals is rational and set of primes dividing an element is infinite

Polynomial and roots problems

Is it advisable to inform the CEO about his brother accessing his office?

Why will we fail creating a self sustaining off world colony?

Can I hire several veteran soldiers to accompany me?

Can you run PoE Cat6 alongside standard Cat6 cables?

What verb goes with "coup"?

GFCI versus circuit breaker

Confusion in understanding the behavior of inductor in RL circuit with DC source

How to idiomatically express the idea "if you can cheat without being caught, do it"

Are there advantages in writing by hand over typing out a story?

Using PTSerif-TLF for Cyrillic with TeX Gyre Pagella

How does entropy depend on location and scale?

What's the difference between the Find Steed and Find Greater Steed spells?

Why should I allow multiple IP addresses on a website for a single session?

Is it OK to say "The situation is pregnant with a crisis"?

How did sloshing prevent the Apollo Service Module from moving safely away from the Command Module and how was this fixed?

Emphasize numbers in tables

How soon after takeoff can you recline your airplane seat?

Why are examinees often not allowed to leave during the start and end of an exam?

Runtime too long for NDSolveValue, FindRoot breaks down at sharp turns

How to model a Coral or Sponge Structure?

How might boat designs change in order to allow them to be pulled by dragons?

Are the plates of a battery really charged?



Column type issue when transferring bulk data between MySQL to Hive through Sqoop


Should I use the datetime or timestamp data type in MySQL?Facing issue for the below command in sqoopsqoop to transfer data to HDFS from Teradatasqoop to mysql importing issuesqoop - connect to oracle and import data to HDFS in IBM BigInsightsSQOOP Import Fails, File Not Found ExceptionSqoop import error message ERROR tool.ImportTool: Import failed: ENOENT: No such file or directory Optionssqoop error : Direct import is not compatible with HCatalog operationssqoop incremental append last modified













0















I'm trying send data from my MySQL thought Sqoop to Hive database. After run, this execution stops with a issue in the column type:



19/03/25 14:26:37 INFO mapreduce.ImportJobBase: Publishing Hive/Hcat import job data to Listeners for table piwik_archive_blob_2019_03
19/03/25 14:26:37 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `piwik_archive_blob_2019_03` AS t LIMIT 1
19/03/25 14:26:37 WARN hive.TableDefWriter: Column date1 had to be cast to a less precise type in Hive
19/03/25 14:26:37 WARN hive.TableDefWriter: Column date2 had to be cast to a less precise type in Hive
19/03/25 14:26:37 WARN hive.TableDefWriter: Column ts_archived had to be cast to a less precise type in Hive
19/03/25 14:26:37 ERROR tool.ImportTool: Import failed: java.io.IOException: Hive does not support the SQL type for column value
 at org.apache.sqoop.hive.TableDefWriter.getCreateTableStmt(TableDefWriter.java:191)
 at org.apache.sqoop.hive.HiveImport.importTable(HiveImport.java:189)
 at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:537)
 at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:628)
 at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
 at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
 at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
 at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
 at org.apache.sqoop.Sqoop.main(Sqoop.java:252)


My import command has the mapping column:



sqoop import 
 -Dorg.apache.sqoop.splitter.allow_text_splitter=true 
 --connect jdbc:mysql://172.18.9.81:3306/piwik 
 --hive-import 
 --hive-table piwik.piwik_archive_blob_2019_03 
 --map-column-hive date1=Date,date2=Date,ts_archived=Date 
 --password 'root' 
 --table piwik_archive_blob_2019_03 
 --username root 
 -m 1





mysql hive sqoop







share|improve this question






















  • I understand that is relationated with JDBC data types, but I try different types and everyone respond with the same error.

    – Bruno Wego
    Mar 25 at 17:53















0















I'm trying send data from my MySQL thought Sqoop to Hive database. After run, this execution stops with a issue in the column type:



19/03/25 14:26:37 INFO mapreduce.ImportJobBase: Publishing Hive/Hcat import job data to Listeners for table piwik_archive_blob_2019_03
19/03/25 14:26:37 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `piwik_archive_blob_2019_03` AS t LIMIT 1
19/03/25 14:26:37 WARN hive.TableDefWriter: Column date1 had to be cast to a less precise type in Hive
19/03/25 14:26:37 WARN hive.TableDefWriter: Column date2 had to be cast to a less precise type in Hive
19/03/25 14:26:37 WARN hive.TableDefWriter: Column ts_archived had to be cast to a less precise type in Hive
19/03/25 14:26:37 ERROR tool.ImportTool: Import failed: java.io.IOException: Hive does not support the SQL type for column value
 at org.apache.sqoop.hive.TableDefWriter.getCreateTableStmt(TableDefWriter.java:191)
 at org.apache.sqoop.hive.HiveImport.importTable(HiveImport.java:189)
 at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:537)
 at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:628)
 at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
 at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
 at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
 at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
 at org.apache.sqoop.Sqoop.main(Sqoop.java:252)


My import command has the mapping column:



sqoop import 
 -Dorg.apache.sqoop.splitter.allow_text_splitter=true 
 --connect jdbc:mysql://172.18.9.81:3306/piwik 
 --hive-import 
 --hive-table piwik.piwik_archive_blob_2019_03 
 --map-column-hive date1=Date,date2=Date,ts_archived=Date 
 --password 'root' 
 --table piwik_archive_blob_2019_03 
 --username root 
 -m 1





mysql hive sqoop







share|improve this question






















  • I understand that is relationated with JDBC data types, but I try different types and everyone respond with the same error.

    – Bruno Wego
    Mar 25 at 17:53













0












0








0








I'm trying send data from my MySQL thought Sqoop to Hive database. After run, this execution stops with a issue in the column type:



19/03/25 14:26:37 INFO mapreduce.ImportJobBase: Publishing Hive/Hcat import job data to Listeners for table piwik_archive_blob_2019_03
19/03/25 14:26:37 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `piwik_archive_blob_2019_03` AS t LIMIT 1
19/03/25 14:26:37 WARN hive.TableDefWriter: Column date1 had to be cast to a less precise type in Hive
19/03/25 14:26:37 WARN hive.TableDefWriter: Column date2 had to be cast to a less precise type in Hive
19/03/25 14:26:37 WARN hive.TableDefWriter: Column ts_archived had to be cast to a less precise type in Hive
19/03/25 14:26:37 ERROR tool.ImportTool: Import failed: java.io.IOException: Hive does not support the SQL type for column value
 at org.apache.sqoop.hive.TableDefWriter.getCreateTableStmt(TableDefWriter.java:191)
 at org.apache.sqoop.hive.HiveImport.importTable(HiveImport.java:189)
 at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:537)
 at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:628)
 at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
 at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
 at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
 at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
 at org.apache.sqoop.Sqoop.main(Sqoop.java:252)


My import command has the mapping column:



sqoop import 
 -Dorg.apache.sqoop.splitter.allow_text_splitter=true 
 --connect jdbc:mysql://172.18.9.81:3306/piwik 
 --hive-import 
 --hive-table piwik.piwik_archive_blob_2019_03 
 --map-column-hive date1=Date,date2=Date,ts_archived=Date 
 --password 'root' 
 --table piwik_archive_blob_2019_03 
 --username root 
 -m 1





mysql hive sqoop







share|improve this question














I'm trying send data from my MySQL thought Sqoop to Hive database. After run, this execution stops with a issue in the column type:



19/03/25 14:26:37 INFO mapreduce.ImportJobBase: Publishing Hive/Hcat import job data to Listeners for table piwik_archive_blob_2019_03
19/03/25 14:26:37 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `piwik_archive_blob_2019_03` AS t LIMIT 1
19/03/25 14:26:37 WARN hive.TableDefWriter: Column date1 had to be cast to a less precise type in Hive
19/03/25 14:26:37 WARN hive.TableDefWriter: Column date2 had to be cast to a less precise type in Hive
19/03/25 14:26:37 WARN hive.TableDefWriter: Column ts_archived had to be cast to a less precise type in Hive
19/03/25 14:26:37 ERROR tool.ImportTool: Import failed: java.io.IOException: Hive does not support the SQL type for column value
 at org.apache.sqoop.hive.TableDefWriter.getCreateTableStmt(TableDefWriter.java:191)
 at org.apache.sqoop.hive.HiveImport.importTable(HiveImport.java:189)
 at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:537)
 at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:628)
 at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
 at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
 at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
 at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
 at org.apache.sqoop.Sqoop.main(Sqoop.java:252)


My import command has the mapping column:



sqoop import 
 -Dorg.apache.sqoop.splitter.allow_text_splitter=true 
 --connect jdbc:mysql://172.18.9.81:3306/piwik 
 --hive-import 
 --hive-table piwik.piwik_archive_blob_2019_03 
 --map-column-hive date1=Date,date2=Date,ts_archived=Date 
 --password 'root' 
 --table piwik_archive_blob_2019_03 
 --username root 
 -m 1





mysql hive sqoop




mysql hive sqoop






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked Mar 25 at 17:33









Bruno WegoBruno Wego

2931 gold badge5 silver badges18 bronze badges




2931 gold badge5 silver badges18 bronze badges












  • I understand that is relationated with JDBC data types, but I try different types and everyone respond with the same error.

    – Bruno Wego
    Mar 25 at 17:53

















  • I understand that is relationated with JDBC data types, but I try different types and everyone respond with the same error.

    – Bruno Wego
    Mar 25 at 17:53
















I understand that is relationated with JDBC data types, but I try different types and everyone respond with the same error.

– Bruno Wego
Mar 25 at 17:53





I understand that is relationated with JDBC data types, but I try different types and everyone respond with the same error.

– Bruno Wego
Mar 25 at 17:53










0






active

oldest

votes










Your Answer






StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55343528%2fcolumn-type-issue-when-transferring-bulk-data-between-mysql-to-hive-through-sqoo%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes




Is this question similar to what you get asked at work? Learn more about asking and sharing private information with your coworkers using Stack Overflow for Teams.







Is this question similar to what you get asked at work? Learn more about asking and sharing private information with your coworkers using Stack Overflow for Teams.



















draft saved

draft discarded
















































Thanks for contributing an answer to Stack Overflow!


  • Please be sure to answer the question. Provide details and share your research!

But avoid …


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55343528%2fcolumn-type-issue-when-transferring-bulk-data-between-mysql-to-hive-through-sqoo%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







-

Popular posts from this blog

Kamusi Yaliyomo Aina za kamusi | Muundo wa kamusi | Faida za kamusi | Dhima ya picha katika kamusi | Marejeo | Tazama pia | Viungo vya nje | UrambazajiKuhusu kamusiGo-SwahiliWiki-KamusiKamusi ya Kiswahili na Kiingerezakuihariri na kuongeza habari

Image
Pages using ISBN magic linksMbegu za lughaKamusiIsimu nenoKiarabukitabulughaKiswahilialfabetimaanaufafanuzimanenomuhtasarisarufividahizoalfabeti Kamusi Kutoka Wikipedia, kamusi elezo huru Jump to navigation Jump to search Kamusi za Kiswahili Kamusi ya Kiswahili-Kiswahili (kamusi wahidiya) Kamusi ya Kiswahili - Kiingereza (kamusi thania) Kamusi (kutoka neno la Kiarabu قاموس qamus ) ni kitabu ambacho kinaorodhesha maneno ya lugha yaliyokusanywa kutoka kwa watumiaji wa lugha fulani, kwa mfano lugha ya Kiswahili. Maneno hupangwa kwa mtindo wa alfabeti, hutoa maana, asili na ufafanuzi wa utumizi wa maneno na jinsi yanavyotumika au yanavyotamkwa. [1] Yaliyomo 1 Aina za kamusi 2 Muundo wa kamusi 2.1 1. Utangulizi wa kamusi 2.2 2. Matini ya kamusi 2.3 3. Sherehe ya kamusi 3 Faida za kamusi 4 Dhima ya picha katika kamusi 5 Marejeo 6 Tazama pia 7 Viungo vya nje Aina za kamusi | Kuna aina mbalimbali za kamusi ambazo ni: Kamusi wahidiya yaani ya l
Read more

Swift 4 - func physicsWorld not invoked on collision? The Next CEO of Stack OverflowHow to call Objective-C code from Swift#ifdef replacement in the Swift language@selector() in Swift?#pragma mark in Swift?Swift for loop: for index, element in array?dispatch_after - GCD in Swift?Swift Beta performance: sorting arraysSplit a String into an array in Swift?The use of Swift 3 @objc inference in Swift 4 mode is deprecated?How to optimize UITableViewCell, because my UITableView lags

Image
Strange use of "whether ... than ..." in official text Could a dragon use its wings to swim? Car headlights in a world without electricity How to avoid supervisors with prejudiced views? Is the offspring between a demon and a celestial possible? If so what is it called and is it in a book somewhere? Can I board the first leg of the flight without having final country's PR card? subequations: How to continue numbering within subequation? How do you define an element with an ID attribute using LWC? Relevant Part for a Badminton Serve What CSS properties can the br tag have? What are the unusually-enlarged wing sections on this P-38 Lightning? Why did early computer designers eschew integers? Is it a bad idea to plug the other end of ESD strap to wall ground? Magento 1.9 observer on only new product added ( no updated product ) Airplane gently rocking its wings during whole flight It is correct to match light sources with the same color temperat
Read more

Access current req object everywhere in Node.js ExpressWhy are global variables considered bad practice? (node.js)Using req & res across functionsHow do I get the path to the current script with Node.js?What is Node.js' Connect, Express and “middleware”?Node.js w/ express error handling in callbackHow to access the GET parameters after “?” in Express?Modify Node.js req object parametersAccess “app” variable inside of ExpressJS/ConnectJS middleware?Node.js Express app - request objectAngular Http Module considered middleware?Session variables in ExpressJSAdd properties to the req object in expressjs with Typescript

Image
What steps should I take to lawfully visit the United States as a tourist immediately after visiting on a B-1 visa? Would dual wielding daggers be a viable choice for a covert bodyguard? For a hashing function like MD5, how similar can two plaintext strings be and still generate the same hash? Using Newton's shell theorem to accelerate a spaceship Why doesn't sea level show seasonality? What prevents someone from claiming to be the murderer in order to get the real murderer off? Has anyone in space seen or photographed a simple laser pointer from Earth? What does (void *)1 mean Why does the U.S. tolerate foreign influence from Saudi Arabia and Israel on its domestic policies while not tolerating that from China or Russia? Modulus Operandi What's the point of having a RAID 1 configuration over incremental backups to a secondary drive? How to ask for a LinkedIn endorsement? Good resources for solving techniques (Metaheuristics, MILP, CP etc) How woul
Read more