CODEWITHSUNDEEP
pythonpandas
James Bond
James Bond

Reputation: 7913

How to merge two dataframes side-by-side?

is there a way to conveniently merge two data frames side by side?

both two data frames have 30 rows, they have different number of columns, say, df1 has 20 columns and df2 has 40 columns.

how can i easily get a new data frame of 30 rows and 60 columns?

df3 = pd.someSpecialMergeFunct(df1, df2)

or maybe there is some special parameter in append

df3 = pd.append(df1, df2, left_index=False, right_index=false, how='left')

ps: if possible, i hope the replicated column names could be resolved automatically.

thanks!

Upvotes: 85

Views: 160824

Answers (6)

Matt
Matt

Reputation: 1284

I found that the other answers didn't cut it for me when coming in from Google.

What I did instead was to set the new columns in place in the original df.

# list(df2) gives you the column names of df2
# you then use these as the column names for df

df[list(df2)] = df2

Upvotes: 2

rachwa
rachwa

Reputation: 2300

This solution also works if df1 and df2 have different indices:

df1.loc[:, df2.columns] = df2.to_numpy()

Upvotes: 0

tsveti_iko
tsveti_iko

Reputation: 7972

If you want to combine 2 data frames with common column name, you can do the following:

df_concat = pd.merge(df1, df2, on='common_column_name', how='outer')

Upvotes: 7

Rohit Madan
Rohit Madan

Reputation: 49

  • There is way, you can do it via a Pipeline.

** Use a pipeline to transform your numerical Data for ex-

Num_pipeline = Pipeline
([("select_numeric", DataFrameSelector([columns with numerical value])),
("imputer", SimpleImputer(strategy="median")),
])

**And for categorical data 

cat_pipeline = Pipeline([
    ("select_cat", DataFrameSelector([columns with categorical data])),
    ("cat_encoder", OneHotEncoder(sparse=False)),
])

** Then use a Feature union to add these transformations together

preprocess_pipeline = FeatureUnion(transformer_list=[
    ("num_pipeline", num_pipeline),
    ("cat_pipeline", cat_pipeline),
])

Upvotes: 0

joris
joris

Reputation: 139162

You can use the concat function for this (axis=1 is to concatenate as columns):

pd.concat([df1, df2], axis=1)

See the pandas docs on merging/concatenating: http://pandas.pydata.org/pandas-docs/stable/merging.html

Upvotes: 147

Jack
Jack

Reputation: 303

I came across your question while I was trying to achieve something like the following:

Merge dataframe sideways

So once I sliced my dataframes, I first ensured that their index are the same. In your case both dataframes needs to be indexed from 0 to 29. Then merged both dataframes by the index.

df1.reset_index(drop=True).merge(df2.reset_index(drop=True), left_index=True, right_index=True)

Upvotes: 16

Related Questions