CODEWITHSUNDEEP
pythonarraysnumpy
Jack
Jack

Reputation: 171

Split numpy array into chunks

I have an array x of len 30. I want to separate it out into chunks of 8 samples each in 2 different ways:

First, I want to separate it avoiding any overlap so that I end up with 3 arrays of length 8 and the final array will be only 6 (due to some samples being missing).

Secondly, I want to separate it so that the final array will be the last 2 samples of the previous array plus the final 6.

I want to do this efficiently on large arrays.

I have tried using np.array_split as follows

x = np.array([1 ,1, 2 ,1 ,1 ,2 ,1, 0 ,3, 1, 2 ,2, 1, 2, 1, 1,50,1 ,1, 1, 1, 4, 1, 11, 15, 0, 0, 1, 1,0])

y = np.array_split(x, np.ceil(len(x)/8))

However, that results in:

y = [array([1, 1, 2, 1, 1, 2, 1, 0]),
     array([3, 1, 2, 2, 1, 2, 1, 1]),
     array([50,  1,  1,  1,  1,  4,  1]),
     array([11, 15,  0,  0,  1,  1,  0])]

But it gives 2x8 length arrays and 2x7 length arrays, not what I want.

How can I achieve this ?

Upvotes: 0

Views: 1138

Answers (4)

Bhargav
Bhargav

Reputation: 4062

Use utilpsace

from utilspie import iterutils

x = np.array([1 ,1, 2 ,1 ,1 ,2 ,1, 0 ,3, 1, 2 ,2, 1, 2, 1, 1,50,1 ,1, 1, 1, 4, 1, 11, 15, 0, 0, 1, 1,0])

print(list(iterutils.get_chunks(x, 8)))

Gives

[array([1, 1, 2, 1, 1, 2, 1, 0]),  #Length 8
 array([3, 1, 2, 2, 1, 2, 1, 1]),  #Length 8
 array([50,  1,  1,  1,  1,  4,  1, 11]), #Length 8
 array([15,  0,  0,  1,  1,  0])]  #Length 6

Solution 2

Fill uneven array lengths with above array elements using bottleNeck

Complete code. ##

import numpy as np
from utilspie import iterutils
import itertools
from bottleneck import push

x = np.array([1 ,1, 2 ,1 ,1 ,2 ,1, 0 ,3, 1, 2 ,2, 1, 2, 1, 1,50,1 ,1, 1, 1, 4, 1, 11, 15, 0, 0, 1, 1,0])

x =(list(iterutils.get_chunks(x, 8)))

x_new=np.array(list(itertools.zip_longest(*x, fillvalue=np.nan))).T

x_new=push(x_new, axis=0)
print(x_new)

Gives #

[[ 1.  1.  2.  1.  1.  2.  1.  0.]  #Length 8
 [ 3.  1.  2.  2.  1.  2.  1.  1.]  #Length 8
 [50.  1.  1.  1.  1.  4.  1. 11.]  #Length 8
 [15.  0.  0.  1.  1.  0.  1. 11.]] #Length 8

Upvotes: 0

harry_09
harry_09

Reputation: 26

import numpy as np

x = np.array([1 ,1, 2 ,1 ,1 ,2 ,1, 0 ,3, 1, 2 ,2, 1, 2, 1, 1,50 ,1 ,1, 1, 1, 4, 1, 11, 15, 0, 0, 1, 1,0])

def split_reminder(x, chunk_size, axis=0):
    indices = np.arange(chunk_size, x.shape[axis], chunk_size)
    return np.array_split(x, indices, axis)

split_reminder(x, 8)

Checkout the below link for reference: Similar answer

Upvotes: 1

user19077881
user19077881

Reputation: 5410

You could split just the part of the array will produces your chunk size then add back on an array of the final 8 values

num = int(len(x)/8)
y = np.array_split(x[:num*8], num)
y += [x[-9:-1]]

Upvotes: 0

Tat
Tat

Reputation: 51

"""for the first you can use range"""
x = np.array([1 ,1, 2 ,1 ,1 ,2 ,1, 0 ,3, 1, 2 ,2, 1, 2, 1, 1,50,1 ,1, 1, 1, 4, 1, 11, 15, 0, 0, 1, 1,0])
res = [x[i:i+8] for i in range(0, len(x), 8)]
"""for the second you could just pop the first item"""
res.pop(0)
print(res)

Upvotes: 0

Related Questions