CODEWITHSUNDEEP
pythonpandas
CodeNinja
CodeNinja

Reputation: 1179

pandas calculate counts by months

how to count items in each month with fill?

data = [
        {"event_date": "2018-08-10", "tags": ["tv", "radio"]},
        {"event_date": "2018-08-11", "tags": ["tv", "radio"]},
        {"event_date": "2018-09-10", "tags": ["tv"]},
        {"event_date": "2018-11-10", "tags": ["tv", "wifi"]}
    ] 
df = pd.DataFrame(data)
df.groupby([(df['event_date']).dt.month, df['tags']]).count()

what I expect:

month tv radio wifi
8 2 2 0
9 1 0 0
10 0 0 0
11 1 0 1

Upvotes: 1

Views: 69

Answers (2)

user3483203
user3483203

Reputation: 51165

A similar method to @Wen, but creating a new DataFrame to avoid the apply:

s = (pd.DataFrame(df.tags.values.tolist(),
        index=df.event_date.dt.month).stack().reset_index(1, drop=True))

Now using pd.get_dummies:

(pd.get_dummies(s).sum(level=0)
    .reindex(np.arange(s.index.min(),s.index.max()+1), fill_value=0))


            radio  tv  wifi
event_date
8               2   2     0
9               0   1     0
10              0   0     0
11              0   1     1

Upvotes: 3

BENY
BENY

Reputation: 323226

So this is unnest ,get_dummies and reindex mixed question 

df.event_date=pd.to_datetime(df.event_date).dt.month

l=list(range(df.event_date.min(),df.event_date.max()+1))
df.set_index('event_date').tags.apply(pd.Series).stack().\
  str.get_dummies().sum(level=0).\
   reindex(l,fill_value=0)
Out[834]: 
            radio  tv  wifi
event_date                 
8               2   2     0
9               0   1     0
10              0   0     0
11              0   1     1

Upvotes: 5

Related Questions