Merge tag 'v0.8.0b1' into debian-0.8

Version 0.8.0 beta 1

* tag 'v0.8.0b1': (703 commits)
  RLS: 0.8.0 beta 1
  RLS: 0.8.0beta
  RLS: release notes
  ENH: add option to use Series.values to interpolate, close pandas-dev#1206
  TST: testing to close pandas-dev#1331
  DOC: groupby drop duplicate index pandas-dev#1312
  ENH: tz_convert for DataFrame pandas-dev#1330
  ENH: add NA handling to scatter_matrix, close pandas-dev#1297
  BUG: display localtime in DatetimeIndex.__repr__, close pandas-dev#1336
  DOC: draft of timeseries section of docs. Added Period related documentation and examples
  DOC: timezone handling and started on Period
  DOC: rough draft of DatetimeIndex, date_range, shifting/resampling etc
  DOC: more ts docs. Need to do resampling then PeriodIndex
  DOC: starting deeper revamp of ts docs for 0.8
  BUG: raise exception for unintellible frequency strings, close pandas-dev#1328
  ENH: construct PeriodIndex from arrays of fields, allow negative ordinals. close pandas-dev#1333 and pandas-dev#1264
  BUG: tsplot fix with business freq pandas-dev#1332
  BUG: DatetimeIndex partial slicing bug, tsplot kludge around pandas-dev#1332
  BUG: alias W to W-SUN, add test for buglet close pandas-dev#1327
  ENH: mix arrays and scalars in DataFrame constructor, close pandas-dev#1329
  ...

Author: yarikoptic

.gitignore

@@ -5,6 +5,9 @@ build
 dist
 MANIFEST
 *.c
+!np_datetime.c
+!np_datetime_strings.c
+!skts.c
 *.cpp
 *.so
 *.pyd
@@ -16,4 +19,5 @@ doc/source/vbench.rst
 *flymake*
 scikits
 .coverage
-pandas.egg-info
+pandas.egg-info
+*\#*\#

NP_LICENSE.txt

@@ -0,0 +1,30 @@
+Copyright (c) 2005-2011, NumPy Developers.
+All rights reserved.
+
+Redistribution and use in source and binary forms, with or without
+modification, are permitted provided that the following conditions are
+met:
+
+    * Redistributions of source code must retain the above copyright
+       notice, this list of conditions and the following disclaimer.
+
+    * Redistributions in binary form must reproduce the above
+       copyright notice, this list of conditions and the following
+       disclaimer in the documentation and/or other materials provided
+       with the distribution.
+
+    * Neither the name of the NumPy Developers nor the names of any
+       contributors may be used to endorse or promote products derived
+       from this software without specific prior written permission.
+
+THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
+"AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
+LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
+A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
+OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
+SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
+LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
+DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
+THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
+(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
+OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

RELEASE.rst

@@ -22,13 +22,107 @@ Where to get it
 * Binary installers on PyPI: http://pypi.python.org/pypi/pandas
 * Documentation: http://pandas.pydata.org
 
+pandas 0.8.0
+============
+
+**Release date:** NOT YET RELEASED
+
+**New features**
+
+  - Add GroupBy.prod optimized aggregation function and 'prod' fast time series
+    conversion method (#1018)
+  - Implement robust frequency inference function and `inferred_freq` attribute
+    on DatetimeIndex (#391)
+  - Convert DatetimeIndexes to UTC if time zones are different in join/setops
+    (#864)
+  - Add limit argument for forward/backward filling to reindex, fillna,
+    etc. (#825 and others)
+  - Add support for indexes (dates or otherwise) with duplicates and common
+    sense indexing/selection functionality
+  - Series/DataFrame.update methods, in-place variant of combine_first (#961)
+  - Add ``match`` function to API (#502)
+  - Add Cython-optimized first, last, min, max, prod functions to GroupBy (#994,
+    #1043)
+  - Dates can be split across multiple columns (#1227, #1186)
+  - Add experimental support for converting pandas DataFrame to R data.frame
+    via rpy2 (#350, #1212)
+  - Can pass list of (name, function) to GroupBy.aggregate to get aggregates in
+    a particular order (#610)
+  - Can pass dicts with lists of functions or dicts to GroupBy aggregate to do
+    much more flexible multiple function aggregation (#642)
+  - New ordered_merge functions for merging DataFrames with ordered
+    data. Also supports group-wise merging for panel data (#813)
+  - Add keys() method to DataFrame
+  - Add flexible replace method for replacing potentially values to Series and
+    DataFrame (#929, #1241)
+  - Add 'kde' plot kind for Series/DataFrame.plot (#1059)
+  - More flexible multiple function aggregation with GroupBy
+  - Add pct_change function to Series/DataFrame
+  - Add option to interpolate by Index values in Series.interpolate (#1206)
+
+**Improvements to existing features**
+
+  - Switch to klib/khash-based hash tables in Index classes for better
+    performance in many cases and lower memory footprint
+  - Shipping some functions from scipy.stats to reduce dependency,
+    e.g. Series.describe and DataFrame.describe (GH #1092)
+  - Can create MultiIndex by passing list of lists or list of arrays to Series,
+    DataFrame constructor, etc. (#831)
+  - Can pass arrays in addition to column names to DataFrame.set_index (#402)
+  - Improve the speed of "square" reindexing of homogeneous DataFrame objects
+    by significant margin (#836)
+  - Handle more dtypes when passed MaskedArrays in DataFrame constructor (#406)
+  - Improved performance of join operations on integer keys (#682)
+  - Can pass multiple columns to GroupBy object, e.g. grouped[[col1, col2]] to
+    only aggregate a subset of the value columns (#383)
+  - Add histogram / kde plot options for scatter_matrix diagonals (#1237)
+  - Add inplace option to Series/DataFrame.rename and sort_index,
+    DataFrame.drop_duplicates (#805, #207)
+  - More helpful error message when nothing passed to Series.reindex (#1267)
+  - Can mix array and scalars as dict-value inputs to DataFrame ctor (#1329)
+
+**API Changes**
+
+  - Raise ValueError in DataFrame.__nonzero__, so "if df" no longer works
+    (#1073)
+  - Change BDay (business day) to not normalize dates by default
+  - Remove deprecated DataMatrix name
+  - Default merge suffixes for overlap now have underscores instead of periods
+    to facilitate tab completion, etc. (#1239)
+
+**Bug fixes**
+
+  - Fix OverflowError from storing pre-1970 dates in HDFStore by switching to
+    datetime64 (GH #179)
+  - Fix logical error with February leap year end in YearEnd offset
+  - Series([False, nan]) was getting casted to float64 (GH #1074)
+  - Fix binary operations between boolean Series and object Series with
+    booleans and NAs (GH #1074)
+  - Couldn't assign whole array to column in mixed-type DataFrame via .ix
+    (#1142)
+  - Fix label slicing issues with float index values (#1167)
+  - Fix segfault caused by empty groups passed to groupby (#1048)
+  - Fix occasionally misbehaved reindexing in the presence of NaN labels (#522)
+  - Fix imprecise logic causing weird Series results from .apply (#1183)
+  - Unstack multiple levels in one shot, avoiding empty columns in some
+    cases. Fix pivot table bug (#1181)
+  - Fix formatting of MultiIndex on Series/DataFrame when index name coincides
+    with label (#1217)
+  - Handle Excel 2003 #N/A as NaN from xlrd (#1213, #1225)
+  - Fix timestamp locale-related deserialization issues with HDFStore by moving
+    to datetime64 representation (#1081, #809)
+  - Fix DataFrame.duplicated/drop_duplicates NA value handling (#557)
+  - Actually raise exceptions in fast reducer (#1243)
+
 pandas 0.7.3
 ============
 
 **Release date:** April 12, 2012
 
 **New features / modules**
 
+  - Support for non-unique indexes: indexing and selection, many-to-one and
+    many-to-many joins (#1306)
   - Added fixed-width file reader, read_fwf (PR #952)
   - Add group_keys argument to groupby to not add group names to MultiIndex in
     result of apply (GH #938)
@@ -63,6 +157,7 @@ pandas 0.7.3
   - Calling apply on grouped Series, e.g. describe(), will no longer yield
     DataFrame by default. Will have to call unstack() to get prior behavior
   - NA handling in non-numeric comparisons has been tightened up (#933, #953)
+  - No longer assign dummy names key_0, key_1, etc. to groupby index (#1291)
 
 **Bug fixes**
 
@@ -86,6 +181,7 @@ pandas 0.7.3
   - Improper int dtype DataFrame construction from data with NaN (GH #846)
   - Removes default 'result' name in grouby results (GH #995)
   - DataFrame.from_records no longer mutate input columns (PR #975)
+  - Use Index name when grouping by it (#1313)
 
 pandas 0.7.2
 ============

TODO.rst

@@ -57,3 +57,4 @@ Performance blog
 - Take
 
 git log v0.6.1..master --pretty=format:%aN | sort | uniq -c | sort -rn
+git log a8c2f88..master --pretty=format:%aN | sort | uniq -c | sort -rn

bench/bench_dense_to_sparse.py

@@ -4,7 +4,7 @@
 N = 100000
 rng = DateRange('1/1/2000', periods=N, offset=datetools.Minute())
 
-rng2 = np.asarray(rng).astype('M8').astype('i8')
+rng2 = np.asarray(rng).astype('M8[us]').astype('i8')
 
 series = {}
 for i in range(1, K + 1):