| commit | ea284d62814cedd59baa20a1db1f44b16abb431d | [log] [tgz] |
|---|---|---|
| author | Yaowu Xu <yaowu@google.com> | Fri Jul 19 17:38:55 2013 -0700 |
| committer | Yaowu Xu <yaowu@google.com> | Fri Jul 19 17:52:50 2013 -0700 |
| tree | 4741ec7dc8fcdba751216e8389bd5c12e47a897e | |
| parent | f00a237a43b86298f18ff9f09c29c4cf965f6d04 [diff] |
added checks to prevent rate/distortion overflow At speed 2, due to the threshold scheme used, it is possible the rate and distortion assigned with INT_MAX value. The patch added checking to prevent the INT_MAX value is used in further calculation of RD scores. The patch also changed the assertion in rd_use_partition() to be mirror similar assertion in rd_pick_partition(). Change-Id: Idb52c543cc1e10abdf6e6a5d6e9cb535a42214dc