CODEWITHSUNDEEP
pythonapicsvexport-to-csv
Hayat
Hayat

Reputation: 1649

SQL query output to .csv

I am running SQL query from python API and want to collect data in Structured(column-wise data under their header).CSV format.

This is the code so far I have.

sql = "SELECT id,author From researches WHERE id < 20 " 
cursor.execute(sql)
data = cursor.fetchall()
print (data)
with open('metadata.csv', 'w', newline='') as f_handle:
    writer = csv.writer(f_handle)
    header = ['id', 'author']
    writer.writerow(header)
    for row in data:
        writer.writerow(row)

Now the data is being printed on the console but not getting in .CSV file this is what I am getting as output:

What is that I am missing?

Upvotes: 0

Views: 29816

Answers (4)

gerard093
gerard093

Reputation: 11

with mysql - export csv with mysqlclient library - utf8

import csv

import MySQLdb as mariadb;
import sys

tablelue="extracted_table"

try:
   conn = mariadb.connect(
      host="127.0.0.1",
      port=3306,
      user="me",
      password="mypasswd",
      database="mydb")

   cur = conn.cursor()

   instruction="show columns from " + tablelue
   cur.execute(instruction)  
   
   myresult = cur.fetchall()
   
   work=list()
   i=0
   for x in myresult:
     work.append(x[0])
     i=i+1


   wsql = "SELECT * FROM " + tablelue
   cur.execute(wsql)
   wdata = cur.fetchall()

   # Create the csv file
   fichecrit=tablelue+".csv"
   with open(fichecrit, 'w', newline='', encoding="utf8") as f_handle:
      writer = csv.writer(f_handle,delimiter=";")
      # Add the header/column names
      header = work
      writer.writerow(header)
      # Iterate over `data`  and  write to the csv file
      for row in wdata:
         writer.writerow(row)
         
   conn.close()

except Exception as e:
   print(f"Error: {e}")

sys.exit(0)

Upvotes: 1

Milovan Tomašević
Milovan Tomašević

Reputation: 8673

You can dump all results to the csv file without looping:

data = cursor.fetchall()
...
writer.writerows(data)

Upvotes: 0

t.Chovatia
t.Chovatia

Reputation: 31

import pandas as pd

import numpy as np

from sqlalchemy import create_engine

from urllib.parse import quote_plus

params = quote_plus(r'Driver={SQL Server};Server=server_name;                        Database=DB_name;Trusted_Connection=yes;')

engine = create_engine("mssql+pyodbc:///?odbc_connect=%s" % params)

sql_string = '''SELECT id,author From researches WHERE id < 20 '''

final_data_fetch = pd.read_sql_query(sql_string, engine)

final_data_fetch.to_csv('file_name.csv')

Hope this helps!

Upvotes: 1

diek
diek

Reputation: 695

Here is a simple example of what you are trying to do: 

import sqlite3 as db
import csv

# Run your query, the result is stored as `data`
with db.connect('vehicles.db') as conn:
    cur = conn.cursor()
    sql = "SELECT make, style, color, plate FROM vehicle_vehicle"
    cur.execute(sql)
    data = cur.fetchall()

# Create the csv file
with open('vehicle.csv', 'w', newline='') as f_handle:
    writer = csv.writer(f_handle)
    # Add the header/column names
    header = ['make', 'style', 'color', 'plate']
    writer.writerow(header)
    # Iterate over `data`  and  write to the csv file
    for row in data:
        writer.writerow(row)

Upvotes: 3

Related Questions