5f305854e6
Increase gm precision from 16 to 32 bit ints
...
Change-Id: I7117a6c14dc8438e4225b50bd2d3ebbaa7f850cc
2016-11-05 16:50:08 -07:00
deaff66955
Merge "Fix the bool coder test" into nextgenv2
2016-11-05 17:43:54 +00:00
99ff89b6fb
Merge "rdopt: clear maybe-uninitialized variable warning" into nextgenv2
2016-11-05 03:19:33 +00:00
70c4fab569
rdopt: clear maybe-uninitialized variable warning
...
av1/encoder/rdopt.c:9533 ‘zeromv[1].as_int’ may be used
uninitialized in this function [-Wmaybe-uninitialized]
this was spurious given the logic in the if
Change-Id: I8ddfe7e46d1bf5593cc8624f05c9f181243a87d4
2016-11-04 17:56:23 -07:00
3e4fcb4ff4
Fix the bool coder test
...
Fix the bool coder test not to use a probability of 100%.
Change-Id: I799871cb0c48580edf0ee15a6c9931d27591ec99
(cherry picked from commit 9b79f6a3d6
2016-11-04 16:07:00 -07:00
713b56121a
Merge "Clean up write_tx_type()" into nextgenv2
2016-11-04 23:03:53 +00:00
0880b5466f
Merge "Refactor tx_type reader" into nextgenv2
2016-11-04 23:03:47 +00:00
05abee1530
Merge "Factor out common tx_type writing codes from inter/intra frame" into nextgenv2
2016-11-04 23:03:38 +00:00
7a77169a35
Merge changes Ia37f170d,Ie3082db5 into nextgenv2
...
* changes:
Record YUV planes' txfm block coeff cost in handle_inter_mode()
Separate coefficient cost of U/V planes in write_modes_b()
2016-11-04 22:58:58 +00:00
59526ead45
Merge changes I3bc782d6,I8359e849,Iae50d0b0,Id1704d88,Ia69f13c4, ... into nextgenv2
...
* changes:
Add av1_ prefix on ###_rd_stats functions
Use init_rd_stats() in encodeframe.c
Add transform block coefficient cost in RD_STATS for debugging
Add helper functions to modify RD_STATS
Add mi_row and mi_col into mbmi to facilitate rd_debug process
Add token cost comparison in write_modes_b()
2016-11-04 22:43:30 +00:00
653fdd6d55
Merge changes I139808f4,I3d97d8db into nextgenv2
...
* changes:
warped_motion.c: delete unused filter_4tap[]
warped_motion.c: quiet float-conversion warnings
2016-11-04 22:34:11 +00:00
628d7c915b
Record YUV planes' txfm block coeff cost in handle_inter_mode()
...
Change-Id: Ia37f170d8fd961d78a751d84b9525ab7e973b81a
2016-11-04 11:12:44 -07:00
c0feea8a0c
Add av1_ prefix on ###_rd_stats functions
...
Change-Id: I3bc782d68bcd9b52b38210eec9eecb21146fde75
2016-11-04 11:12:44 -07:00
75f45814ba
Separate coefficient cost of U/V planes in write_modes_b()
...
Change-Id: Ie3082db5b0fead8c322b2aeede4eff7cd723ea12
2016-11-04 11:12:44 -07:00
4695b97030
Use init_rd_stats() in encodeframe.c
...
Change-Id: I8359e8498efd301ff81eea1d7466d0f3fec5e006
2016-11-04 11:11:27 -07:00
d81fdb41e6
Add transform block coefficient cost in RD_STATS for debugging
...
Change-Id: Iae50d0b0c4f8f383ab4f91d2c1c2fa4e799c7250
2016-11-04 11:11:27 -07:00
d7246171b5
Add helper functions to modify RD_STATS
...
Those functions includes
init_rd_stats()
invalid_rd_stats()
merge_rd_stats()
This CL help simplify the code.
Change-Id: Id1704d883bd21a039b0478a940994ca14184ae1c
2016-11-04 11:11:27 -07:00
394c337754
Add mi_row and mi_col into mbmi to facilitate rd_debug process
...
Change-Id: Ia69f13c47f2dd34fabd220652691049166a06a68
2016-11-04 11:09:24 -07:00
d402282f69
Add token cost comparison in write_modes_b()
...
This is just partial implementation
Compare token cost of pack_mb_tokens/pack_txb_tokens with token cost
from rate-distortion loop. If there is any difference, dump out mode
info.
Change-Id: I46b373ee2522c5047f799f36baf7cec5fbc06f06
2016-11-04 11:09:24 -07:00
4be3214fec
Merge "Properly schedule the transform block recursion order" into nextgenv2
2016-11-04 17:53:53 +00:00
641b1ad5ad
Clean up write_tx_type()
...
Remove repeated mbmi->tx_size calls.
Change-Id: I3e4e03b69b2efffd860cc1ea34e150f4257bf081
2016-11-04 10:36:20 -07:00
ab7163db08
Refactor tx_type reader
...
Factor out common codes. Remove repeated mbmi->tx_size calls.
Change-Id: Id5de35e88f1a5f16223eaa06fc2c9f69124061ef
2016-11-04 10:35:34 -07:00
2a4da9476b
Factor out common tx_type writing codes from inter/intra frame
...
Change-Id: Id2626bd19db2504756d9a1dee709c2d08c79f771
2016-11-04 10:33:12 -07:00
95a3898cbd
Merge "Remove duplicated variables in EXT_INTER" into nextgenv2
2016-11-04 17:11:08 +00:00
98d6a1f247
Properly schedule the transform block recursion order
...
This commit replaces the offset based block index calculation with
incremental based one. It does not change the coding statistics.
Change-Id: I3789294eb45416bd0823e773ec30f05ed41ba0dc
2016-11-04 09:06:49 -07:00
137b2671eb
Fix format issue in handle_inter_mode()
...
Change-Id: I681fd799cf46991de419cc867ccb649a6990c19d
2016-11-04 08:31:24 -07:00
68d695b7ca
Merge "Further work on 64x64 fwd/inv transform support" into nextgenv2
2016-11-04 09:32:07 +00:00
e89ea0ceb7
Merge "Refactor: Replace rate dist sse skip by RD_STATS in VAR_TX" into nextgenv2
2016-11-04 05:42:59 +00:00
21378b8ad0
Merge "Fix bilateral filter asan error for highbitdepth" into nextgenv2
2016-11-04 05:25:49 +00:00
5d54c175c2
warped_motion.c: delete unused filter_4tap[]
...
Change-Id: I139808f492a9e9dcac44a36237b61231ede7edc3
2016-11-03 20:12:20 -07:00
4846e446c6
warped_motion.c: quiet float-conversion warnings
...
Change-Id: I3d97d8db51a5a5d6b2c1cae47492b53ab37100a7
2016-11-03 20:11:06 -07:00
005ff81598
Merge "warped_motion: Fix ubsan warning for signed integer overflow" into nextgenv2
2016-11-04 00:58:07 +00:00
9371394492
Merge "Fix ubsan divide by zero warning in ransac" into nextgenv2
2016-11-04 00:56:23 +00:00
db92635745
warped_motion: Fix ubsan warning for signed integer overflow
...
Change-Id: Ie698aa02ef56128759c71079e9bfa1af25149644
2016-11-04 00:54:25 +00:00
b5dda4887b
Refactor: Replace rate dist sse skip by RD_STATS in VAR_TX
...
This is to facilitate implementation of rd_debug tool; it doesn't change
coding behavior.
Change-Id: I0eb82b31473883ba6652ed11dca09b9ec4530183
2016-11-03 17:51:26 -07:00
c57924cb9e
Fix bilateral filter asan error for highbitdepth
...
BUG=webm:1334
Change-Id: I5886eec0a22a8cc056e1bdb493d2faf183816656
2016-11-03 16:23:09 -07:00
97a2c675e7
Merge "rdopt,global-motion: Fix -1 indexing ubsan warning" into nextgenv2
2016-11-03 22:59:34 +00:00
182953b299
rdopt,global-motion: Fix -1 indexing ubsan warning
...
Change-Id: I1b3caf3543ab385f39f5f253c9949ad89ea5af7d
2016-11-03 22:58:47 +00:00
5cb72a2dba
Merge "Use TX_SIZES in intra_high_pred_fn declarations" into nextgenv2
2016-11-03 22:13:34 +00:00
9d3e478e72
Remove duplicated variables in EXT_INTER
...
Introduced by merge commit 141f7a9
2016-11-03 15:12:42 -07:00
b60c138cdf
Merge "Make inline function static to fix clang compile error" into nextgenv2
2016-11-03 22:09:46 +00:00
9613758e71
Merge "Don't use a TX_SIZE as a TX_TYPE" into nextgenv2
2016-11-03 21:44:21 +00:00
6a47cff882
Further work on 64x64 fwd/inv transform support
...
For higher level fwd and inv transform functions.
Change-Id: I91518250a0be7d94aada7519f6c9e7ed024574fb
2016-11-03 14:32:54 -07:00
fa75ae0663
Fix ubsan divide by zero warning in ransac
...
Change-Id: I8c736ff665a27ce8307fd62571b9728333756d7e
2016-11-03 13:03:45 -07:00
d65708a375
Merge "Replace hard coded numbers with TX_SIZES macro" into nextgenv2
2016-11-03 19:59:10 +00:00
a504e77a98
Merge "Fix txb_w/h use case in av1_tx_block_rd_b()" into nextgenv2
2016-11-03 19:31:48 +00:00
565f788de9
Merge "fix build issue with --enable-delta-q" into nextgenv2
2016-11-03 18:45:57 +00:00
fb3971e55a
Make inline function static to fix clang compile error
...
Change-Id: I0432b8274a2764ba978dd6c4ed532fb7e4b7b519
2016-11-03 10:50:50 -07:00
86b56742fb
Use TX_SIZES in intra_high_pred_fn declarations
...
Change-Id: I078bb5244dbff153bcfab226206540ca6cebdad0
2016-11-03 10:28:11 -07:00
f0ede18718
Don't use a TX_SIZE as a TX_TYPE
...
Change-Id: I26b02e6578ad2d82aadfe1df2aeb84e6c11a747b
2016-11-03 10:28:05 -07:00
Debargha Mukherjee
Yaowu Xu
James Zern
Sarah Parker
Yushin Cho
Jingning Han
Angie Chiang
Yue Chen
Alex Converse