{"id":1780,"date":"2021-01-21T15:30:33","date_gmt":"2021-01-21T18:30:33","guid":{"rendered":"https:\/\/kondado.com.br\/blog\/wiki\/?p=1780"},"modified":"2021-10-08T11:44:47","modified_gmt":"2021-10-08T14:44:47","slug":"como-adicionar-o-conector-do-google-cloud-storage-na-kondado","status":"publish","type":"post","link":"https:\/\/kondado.com.br\/blog\/wiki\/2021\/01\/21\/como-adicionar-o-conector-do-google-cloud-storage-na-kondado\/","title":{"rendered":"Google Cloud Storage"},"content":{"rendered":"\n<p>O Google Cloud Storage \u00e9 um servi\u00e7o para armazenamento de objetos e arquivos (por exemplo CSV e JSON) no Google Cloud.<\/p>\n\n\n\n<p>Ao adicionar o conector do Google Cloud Storage na Kondado, voc\u00ea poder\u00e1 criar ETLs dos seus arquivos diretamente para o seu Data Warehouse ou Data Lake com apenas alguns cliques.<\/p>\n\n\n\n<h2>Adicionando o conector<\/h2>\n\n\n\n<p>Para adicionar o conecto do Google Cloud Storage, siga os passos abaixo:<\/p>\n\n\n\n<p>1) Acesse a sua conta do Google Cloud<\/p>\n\n\n\n<p>2) Clique <a href=\"https:\/\/console.cloud.google.com\/iam-admin\/serviceaccounts\">neste link<\/a> para acessar a se\u00e7\u00e3o de Service Accounts, ou siga a imagem abaixo:<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter\"><img loading=\"lazy\" width=\"465\" height=\"636\" src=\"https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-35.png\" alt=\"\" class=\"wp-image-1783\" srcset=\"https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-35.png 465w, https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-35-219x300.png 219w\" sizes=\"(max-width: 465px) 100vw, 465px\" \/><\/figure><\/div>\n\n\n\n<p>3) Uma vez na se\u00e7\u00e3o de Service Accounts, clique em &#8220;CREATE SERVICE ACCOUNT&#8221;<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" width=\"877\" height=\"251\" src=\"https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-34.png\" alt=\"\" class=\"wp-image-1784\" srcset=\"https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-34.png 877w, https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-34-300x86.png 300w, https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-34-768x220.png 768w\" sizes=\"(max-width: 877px) 100vw, 877px\" \/><\/figure>\n\n\n\n<p>4) No primeiro passo, preencha um nome para a sua service account (por exemplo, &#8220;kondado gcs&#8221;) e clique em &#8220;CREATE&#8221;<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter\"><img loading=\"lazy\" width=\"550\" height=\"433\" src=\"https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-36.png\" alt=\"\" class=\"wp-image-1785\" srcset=\"https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-36.png 550w, https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-36-300x236.png 300w\" sizes=\"(max-width: 550px) 100vw, 550px\" \/><\/figure><\/div>\n\n\n\n<p>5) No segundo passo do processo de cria\u00e7\u00e3o, selecione o Role &#8220;Storage Object Admin&#8221; e clique em CONTINUE<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" width=\"504\" height=\"325\" src=\"https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-37.png\" alt=\"\" class=\"wp-image-1786\" srcset=\"https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-37.png 504w, https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-37-300x193.png 300w\" sizes=\"(max-width: 504px) 100vw, 504px\" \/><\/figure>\n\n\n\n<p>6) Agora basta clicar em &#8220;DONE&#8221; para finalizar a cria\u00e7\u00e3o<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" width=\"572\" height=\"524\" src=\"https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-38.png\" alt=\"\" class=\"wp-image-1787\" srcset=\"https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-38.png 572w, https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-38-300x275.png 300w\" sizes=\"(max-width: 572px) 100vw, 572px\" \/><\/figure>\n\n\n\n<p>7) Uma vez criada, voc\u00ea ser\u00e1 direcionado para uma lista de todas as service accounts ativas. Localize a que voc\u00ea acabou de criar e, nos tr\u00eas pontos verticais \u00e0 direita, clique em &#8220;Create key&#8221;<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" width=\"663\" height=\"533\" src=\"https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-39.png\" alt=\"\" class=\"wp-image-1788\" srcset=\"https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-39.png 663w, https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-39-300x241.png 300w\" sizes=\"(max-width: 663px) 100vw, 663px\" \/><\/figure>\n\n\n\n<p>8) No di\u00e1logo, selecione o tipo &#8220;JSON&#8221; e depois clique em &#8220;CREATE&#8221;<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" width=\"569\" height=\"361\" src=\"https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-40.png\" alt=\"\" class=\"wp-image-1789\" srcset=\"https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-40.png 569w, https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-40-300x190.png 300w\" sizes=\"(max-width: 569px) 100vw, 569px\" \/><\/figure>\n\n\n\n<p>9) Ap\u00f3s clicar em criar, a chave ser\u00e1 baixada no seu computador. Abra o arquivo que fez download em um editor de texto, ele ter\u00e1 um formato parecido com este:<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter\"><img loading=\"lazy\" width=\"459\" height=\"185\" src=\"https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-41.png\" alt=\"\" class=\"wp-image-1790\" srcset=\"https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-41.png 459w, https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/Untitled-drawing-41-300x121.png 300w\" sizes=\"(max-width: 459px) 100vw, 459px\" \/><\/figure><\/div>\n\n\n\n<p>10) Fa\u00e7a login na Kondado, v\u00e1 para a <a href=\"https:\/\/kondado.com.br\/blog\/wiki\/adicionando-conectores-na-plataforma-da-kondado\/\" data-type=\"URL\" data-id=\"https:\/\/kondado.com.br\/blog\/wiki\/adicionando-conectores-na-plataforma-da-kondado\/\">p\u00e1gina de adicionar conectores<\/a> e selecione o conector do Google Cloud Storage<\/p>\n\n\n\n<p>11) Na p\u00e1gina de adi\u00e7\u00e3o do conector, fa\u00e7a o seguinte:<\/p>\n\n\n\n<ul><li>Em &#8220;Bucket&#8221; preencha o nome do seu bucket<\/li><li>Em &#8220;Credencial JSON&#8221;, copie e cole os valores do arquivo do passo (9)<\/li><\/ul>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter\"><img loading=\"lazy\" width=\"554\" height=\"451\" src=\"https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/image-2.png\" alt=\"\" class=\"wp-image-1791\" srcset=\"https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/image-2.png 554w, https:\/\/kondado.com.br\/blog\/wiki\/wp-content\/uploads\/sites\/2\/2021\/01\/image-2-300x244.png 300w\" sizes=\"(max-width: 554px) 100vw, 554px\" \/><\/figure><\/div>\n\n\n\n<p>12) Agora basta clicar em &#8220;SALVAR&#8221; e voc\u00ea estar\u00e1 pronto para enviar seus arquivos do Google Cloud Storage para o seu Data Warehouse ou Data Lake<\/p>\n\n\n\n<h2>Integra\u00e7\u00f5es<\/h2>\n\n\n\n<center>\n\t\t<a style=\"width: 100%; min-width: 100%\" href=\"https:\/\/kdd-public-files.s3.amazonaws.com\/wiki\/erd\/google_cloud_storage.svg\" target=\"_blank\" rel=\"noopener\">\n\t\t\t<div style=\"border-top:1px solid gray; border-bottom:1px solid gray; padding-bottom:10px; display: block;margin-left: auto;margin-right: auto;width: 100%; background-color: #efeaee\">\n\t\t\t\t<p style=\"width: 100%; min-width: 100%\">\n\t\t\t\t\t<p style=\"width: 100%; min-width: 100%; font-weight: bold; text-decoration: underline;\">\n\t\t\t\t\t\tGr\u00e1fico de relacionamento entre tabelas\n\t\t\t\t\t<\/p>\n\t\t\t\t\t<p style=\"width: 100%; min-width: 100%\">\n\t\t\t\t\t\t<div style=\"display: block;margin-left: auto;margin-right: auto;width: 50%; height:auto; background-color: white\">\n\t\t\t\t\t\t\t<img src=\"https:\/\/kdd-public-files.s3.amazonaws.com\/wiki\/erd\/google_cloud_storage.svg\" style=\"display: block;margin-left: auto;margin-right: auto;width: 150px;\">\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/p>\n\t\t\t\t<\/p>\n\t\t\t<\/div>\n\t\t<\/a>\t\n\t<\/center>\n\n\n\n<h3><strong>CSV<\/strong><\/h3>\n\n\n\n<p>Voc\u00ea poder\u00e1 indicar o nome de um arquivo ou mesmo o in\u00edcio do nome do arquivo e iremos integrar todos eles.<\/p>\n\n\n\n<p>Uma vez executada, a integra\u00e7\u00e3o ir\u00e1 guardar a maior data de altera\u00e7\u00e3o dos arquivos que leu e, na pr\u00f3xima execu\u00e7\u00e3o, buscar apenas arquivos que possuem data de altera\u00e7\u00e3o posterior.<\/p>\n\n\n\n<p>Para poder absorver arquivos com colunas diferentes, os dados ser\u00e3o pivotados no destino e seguir\u00e3o o seguinte padr\u00e3o:<\/p>\n\n\n\n<!--- __kdd_doc_updated:2021-12-04T17:30:15.499327Z --->\n<a name=\"parent_pipeline_type:csv\"><\/a>\n<div style=\"padding-left:10%\"><table>\n\n\t\t\t  <tr style=\"border-bottom:1px solid gray\">\n\t\t\t    <th><small><b>Campo<\/b><\/small><\/th>\n\t\t\t    <th style=\"padding-left:10px\"><small><b>Tipo<\/b><\/small><\/th>\n\t\t\t    <th style=\"padding-left:10px\"><small><b><\/b><\/small><\/th>\n\t\t\t  <\/tr>\n\t\t\n\n\t\t\t\t<tr>\n\t\t\t\t\t<td style=\"vertical-align:top\"><small><p>row_number<\/p><\/small><\/td>\n\t\t\t\t\t<td style=\"padding-left:10px;vertical-align:top;\n\"><small><p>int<\/p><\/small><\/td>\n\t\t\t\t\t<td style=\"padding-left:10px;vertical-align:top;\n\"><small><\/small><\/td>\n\t\t\t\t<\/tr>\n\t\t\t\n\n\t\t\t\t<tr>\n\t\t\t\t\t<td style=\"vertical-align:top\"><small><p>column_number<\/p><\/small><\/td>\n\t\t\t\t\t<td style=\"padding-left:10px;vertical-align:top;\n\"><small><p>int<\/p><\/small><\/td>\n\t\t\t\t\t<td style=\"padding-left:10px;vertical-align:top;\n\"><small><\/small><\/td>\n\t\t\t\t<\/tr>\n\t\t\t\n\n\t\t\t\t<tr>\n\t\t\t\t\t<td style=\"vertical-align:top\"><small><p>first_column_value<\/p><\/small><\/td>\n\t\t\t\t\t<td style=\"padding-left:10px;vertical-align:top;\n\"><small><p>text<\/p><\/small><\/td>\n\t\t\t\t\t<td style=\"padding-left:10px;vertical-align:top;\n\"><small><\/small><\/td>\n\t\t\t\t<\/tr>\n\t\t\t\n\n\t\t\t\t<tr>\n\t\t\t\t\t<td style=\"vertical-align:top\"><small><p>value<\/p><\/small><\/td>\n\t\t\t\t\t<td style=\"padding-left:10px;vertical-align:top;\n\"><small><p>text<\/p><\/small><\/td>\n\t\t\t\t\t<td style=\"padding-left:10px;vertical-align:top;\n\"><small><\/small><\/td>\n\t\t\t\t<\/tr>\n\t\t\t\n\n\t\t\t\t<tr>\n\t\t\t\t\t<td style=\"vertical-align:top\"><small><p>__file_basename<\/p><\/small><\/td>\n\t\t\t\t\t<td style=\"padding-left:10px;vertical-align:top;\n\"><small><p>text<\/p><\/small><\/td>\n\t\t\t\t\t<td style=\"padding-left:10px;vertical-align:top;\n\"><small><\/small><\/td>\n\t\t\t\t<\/tr>\n\t\t\t\n\n\t\t\t\t<tr>\n\t\t\t\t\t<td style=\"vertical-align:top\"><small><p>__file_path<\/p><\/small><\/td>\n\t\t\t\t\t<td style=\"padding-left:10px;vertical-align:top;\n\"><small><p>text<\/p><\/small><\/td>\n\t\t\t\t\t<td style=\"padding-left:10px;vertical-align:top;\n\"><small><\/small><\/td>\n\t\t\t\t<\/tr>\n\t\t\t\n\n\t\t\t\t<tr>\n\t\t\t\t\t<td style=\"vertical-align:top\"><small><p>__file_name<\/p><\/small><\/td>\n\t\t\t\t\t<td style=\"padding-left:10px;vertical-align:top;\n\"><small><p>text<\/p><\/small><\/td>\n\t\t\t\t\t<td style=\"padding-left:10px;vertical-align:top;\n\"><small><\/small><\/td>\n\t\t\t\t<\/tr>\n\t\t\t\n\n\t\t\t\t<tr>\n\t\t\t\t\t<td style=\"vertical-align:top\"><small><p>__kdd_insert_time<\/p><\/small><\/td>\n\t\t\t\t\t<td style=\"padding-left:10px;vertical-align:top;\n\"><small><p>timestamp<\/p><\/small><\/td>\n\t\t\t\t\t<td style=\"padding-left:10px;vertical-align:top;\n\"><small><\/small><\/td>\n\t\t\t\t<\/tr>\n\t\t\t\n<\/table><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Veja como adicionar o conector do Google Cloud Storage na Kondado para criar integra\u00e7\u00f5es de dados dos seus arquivos diretamente para o seu Data Warehouse ou Data Lake com apenas alguns cliques.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[229],"tags":[375,376,381,380,379,378,377,383],"_links":{"self":[{"href":"https:\/\/kondado.com.br\/blog\/wiki\/wp-json\/wp\/v2\/posts\/1780"}],"collection":[{"href":"https:\/\/kondado.com.br\/blog\/wiki\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kondado.com.br\/blog\/wiki\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kondado.com.br\/blog\/wiki\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/kondado.com.br\/blog\/wiki\/wp-json\/wp\/v2\/comments?post=1780"}],"version-history":[{"count":7,"href":"https:\/\/kondado.com.br\/blog\/wiki\/wp-json\/wp\/v2\/posts\/1780\/revisions"}],"predecessor-version":[{"id":6103,"href":"https:\/\/kondado.com.br\/blog\/wiki\/wp-json\/wp\/v2\/posts\/1780\/revisions\/6103"}],"wp:attachment":[{"href":"https:\/\/kondado.com.br\/blog\/wiki\/wp-json\/wp\/v2\/media?parent=1780"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kondado.com.br\/blog\/wiki\/wp-json\/wp\/v2\/categories?post=1780"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kondado.com.br\/blog\/wiki\/wp-json\/wp\/v2\/tags?post=1780"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}