PANDAS in deep learning ( AI )

In this post we will discuss about pandas which is open source library in python written in assembly language to effectively and efficiently handle tabular data. we will also discuss why and how to use pandas in deep learning as a data handling tool

what is pandas?

 

pandas is python library developed to handle huge tabular data locally. It can manipulate data as you wish in efficient manner. You can sort , merge ,categorize data using pandas. You can handle date time format in it. You can import data in pandas from many different sources through database server ,CSV file, JSON and many others .

Perceptually

 

It is a database server running locally in python environment. You can apply all database query in pandas using python language.

STRUCTURE

 

Pandas is structured from ndarrays of NUMPY. In pandas there are three terms used to handle data they are:-

 

  1. Series- it is ndarray of one direction . You can consider it as a column in tabular format. it is saved as NUMPY.
  2. Dataframe- It is collection of number of series in it. it is also called as two dimensional array. we mainly deal with this type as this is highly related with database row column system .
  3. PANEL- It is collection of number of dataframe in it. it is also called three dimensional array.

it is supported by almost all Deep learning frameworks available on internet due to efficiency . it is used and supported by tensorflow, Pytorch, scipy, fastai, keras and many more. It's functionality to transfer data to NUMPY makes it more popular . it also uses mathplatlib to show histogram and graph to show data in it.

BASIC USAGE through example

Installation - python installs pandas

download CSV - Iris flower dataset

 

import pandas as pd
data = pd. read_csv ('iris.csv')
data.head() #view data
SL=data['sepal_lenght'] # takecolumndata
data['sepal_lenght'][0]=1.6 #manupulate data
data.drop('sepal_lenght',inplace=True) # drop column
data['NEW']=1.6 # add new column
data.dtypes # check data type
C =data.iloc[2][1] # retrive data through index
 

Conclude :-

In this post we have discussed about pandas and its usage in deep learning. we have also shown some of the commands used in pandas. If you want to learn more about pandas visit this link.If you need any help or assistance comment us here . we will be happy to help you .




Taher Ali Badnawarwala

Taher Ali, drives to create something special, He loves swimming ,family and AI from depth of his heart . He loves to write and make videos about AI and its usage


Leave a Comment


No Comments Yet

Leave a Reply

Your email address will not be published. Required fields are marked *