CODEWITHSUNDEEP
pythonpandas
saurabh agarwal
saurabh agarwal

Reputation: 2174

indexerror: indices out of the bound

I am using StratifiedKFold to create the indexes for splitting my data. It is giving me indices out of bound error. Indices of Xdev is from 0 to 47503. cv_index variable has min and max index as 0 and 10452, then why this error is coming? 

print X_dev.shape
print Y_dev.shape
skff = StratifiedKFold(Y_dev,5)
for train_index, cv_index in skff:
    print train_index.min()
    print train_index.max()
    print cv_index.min()
    print cv_index.max()
    print train_index
    print cv_index
    print train_index.shape
    print cv_index.shape
    X_train = X_dev[cv_index]

Output 

(47504, 128)
(47504,)
9049
47503
0
10452
[ 9049  9051  9054 ..., 47501 47502 47503]
[    0     1     2 ..., 10177 10242 10452]
(38000,)
(9504,)
---------------------------------------------------------------------------
IndexError                                Traceback (most recent call last)
<ipython-input-18-c911fae5d719> in <module>()
     10     print train_index.shape
     11     print cv_index.shape
---> 12     X_train = X_dev[cv_index]

/home/saurabh/anaconda/lib/python2.7/site-packages/pandas/core/frame.pyc in __getitem__(self, key)
   1789         if isinstance(key, (Series, np.ndarray, Index, list)):
   1790             # either boolean or fancy integer index
-> 1791             return self._getitem_array(key)
   1792         elif isinstance(key, DataFrame):
   1793             return self._getitem_frame(key)

/home/saurabh/anaconda/lib/python2.7/site-packages/pandas/core/frame.pyc in _getitem_array(self, key)
   1834         else:
   1835             indexer = self.ix._convert_to_indexer(key, axis=1)
-> 1836             return self.take(indexer, axis=1, convert=True)
   1837 
   1838     def _getitem_multilevel(self, key):

/home/saurabh/anaconda/lib/python2.7/site-packages/pandas/core/generic.pyc in take(self, indices, axis, convert, is_copy)
   1356         new_data = self._data.take(indices,
   1357                                    axis=self._get_block_manager_axis(axis),
-> 1358                                    convert=True, verify=True)
   1359         result = self._constructor(new_data).__finalize__(self)
   1360 

/home/saurabh/anaconda/lib/python2.7/site-packages/pandas/core/internals.pyc in take(self, indexer, axis, verify, convert)
   3264         n = self.shape[axis]
   3265         if convert:
-> 3266             indexer = maybe_convert_indices(indexer, n)
   3267 
   3268         if verify:

/home/saurabh/anaconda/lib/python2.7/site-packages/pandas/core/indexing.pyc in maybe_convert_indices(indices, n)
   1709     mask = (indices >= n) | (indices < 0)
   1710     if mask.any():
-> 1711         raise IndexError("indices are out-of-bounds")
   1712     return indices
   1713 

IndexError: indices are out-of-bounds

I added the information which i thought is relevant. Please let me know if any more information is required to counter this question.

Upvotes: 1

Views: 851

Answers (1)

saurabh agarwal
saurabh agarwal

Reputation: 2174

This example works with lower dimension data but I dont't know why it is not working for this dimension. so I change line 

 X_train = X_dev[cv_index]

to 

X_train = X_dev.ix[cv_index]

and its working .

Upvotes: 2

Related Questions