Line: 4: incorrect codeowner user: ngxson Line: 4: no users/groups matched Line: 5: incorrect codeowner user: slaren Line: 5: incorrect codeowner user: CISC Line: 5: no users/groups matched Line: 6: incorrect codeowner user: CISC Line: 6: no users/groups matched Line: 7: incorrect codeowner user: slaren Line: 7: no users/groups matched Line: 8: incorrect codeowner user: slaren Line: 8: no users/groups matched Line: 9: incorrect codeowner user: ggerganov Line: 9: no users/groups matched Line: 10: incorrect codeowner user: ggerganov Line: 10: no users/groups matched Line: 11: incorrect codeowner user: ggerganov Line: 11: no users/groups matched Line: 12: incorrect codeowner user: ggerganov Line: 12: incorrect codeowner user: ericcurtin Line: 12: no users/groups matched Line: 13: incorrect codeowner user: ggerganov Line: 13: no users/groups matched Line: 14: incorrect codeowner user: ggerganov Line: 14: no users/groups matched Line: 15: incorrect codeowner user: ggerganov Line: 15: no users/groups matched Line: 16: incorrect codeowner user: ggerganov Line: 16: no users/groups matched Line: 17: incorrect codeowner user: angt Line: 17: no users/groups matched Line: 18: incorrect codeowner user: ggerganov Line: 18: no users/groups matched Line: 19: incorrect codeowner user: ggerganov Line: 19: no users/groups matched Line: 20: incorrect codeowner user: ggerganov Line: 20: no users/groups matched Line: 21: incorrect codeowner user: ggerganov Line: 21: no users/groups matched Line: 22: incorrect codeowner user: CISC Line: 22: no users/groups matched Line: 23: incorrect codeowner user: ggerganov Line: 23: no users/groups matched Line: 24: incorrect codeowner user: ggerganov Line: 24: no users/groups matched Line: 25: incorrect codeowner user: ggerganov Line: 25: no users/groups matched Line: 26: incorrect codeowner user: ggerganov Line: 26: no users/groups matched Line: 27: incorrect codeowner user: am17an Line: 27: no users/groups matched Line: 28: incorrect codeowner user: ggerganov Line: 28: no users/groups matched Line: 29: incorrect codeowner user: ggerganov Line: 29: no users/groups matched Line: 30: incorrect codeowner user: ggerganov Line: 30: no users/groups matched Line: 31: incorrect codeowner user: ggerganov Line: 31: no users/groups matched Line: 32: incorrect codeowner user: ggerganov Line: 32: no users/groups matched Line: 33: incorrect codeowner user: ggerganov Line: 33: no users/groups matched Line: 34: incorrect codeowner user: ggerganov Line: 34: no users/groups matched Line: 35: incorrect codeowner user: ggerganov Line: 35: no users/groups matched Line: 36: incorrect codeowner user: ggerganov Line: 36: no users/groups matched Line: 37: incorrect codeowner user: JohannesGaessler Line: 37: no users/groups matched Line: 38: incorrect codeowner user: danbev Line: 38: no users/groups matched Line: 39: incorrect codeowner user: ggerganov Line: 39: no users/groups matched Line: 40: incorrect codeowner user: ggerganov Line: 40: no users/groups matched Line: 41: incorrect codeowner user: ggerganov Line: 41: no users/groups matched Line: 42: incorrect codeowner user: ggerganov Line: 42: no users/groups matched Line: 43: incorrect codeowner user: slaren Line: 43: no users/groups matched Line: 44: incorrect codeowner user: slaren Line: 44: no users/groups matched Line: 45: incorrect codeowner user: ggerganov Line: 45: no users/groups matched Line: 46: incorrect codeowner user: ggerganov Line: 46: no users/groups matched Line: 47: incorrect codeowner user: ggerganov Line: 47: no users/groups matched Line: 48: incorrect codeowner user: ggerganov Line: 48: incorrect codeowner user: slaren Line: 48: no users/groups matched Line: 49: incorrect codeowner user: slaren Line: 49: no users/groups matched Line: 50: incorrect codeowner user: slaren Line: 50: no users/groups matched Line: 51: incorrect codeowner user: slaren Line: 51: no users/groups matched Line: 52: incorrect codeowner user: ggerganov Line: 52: incorrect codeowner user: slaren Line: 52: no users/groups matched Line: 53: incorrect codeowner user: ggerganov Line: 53: incorrect codeowner user: slaren Line: 53: no users/groups matched Line: 54: incorrect codeowner user: alex-spacemit Line: 54: no users/groups matched Line: 55: incorrect codeowner user: slaren Line: 55: no users/groups matched Line: 56: incorrect codeowner user: JohannesGaessler Line: 56: no users/groups matched Line: 57: incorrect codeowner user: slaren Line: 57: no users/groups matched Line: 58: incorrect codeowner user: JohannesGaessler Line: 58: incorrect codeowner user: am17an Line: 58: no users/groups matched Line: 59: incorrect codeowner user: JohannesGaessler Line: 59: no users/groups matched Line: 60: incorrect codeowner user: JohannesGaessler Line: 60: no users/groups matched Line: 61: incorrect codeowner user: JohannesGaessler Line: 61: no users/groups matched Line: 62: incorrect codeowner user: IMbackK Line: 62: no users/groups matched Line: 63: incorrect codeowner user: IMbackK Line: 63: no users/groups matched Line: 64: incorrect codeowner user: IMbackK Line: 64: no users/groups matched Line: 65: incorrect codeowner user: ggerganov Line: 65: incorrect codeowner user: slaren Line: 65: no users/groups matched Line: 66: incorrect codeowner user: ggerganov Line: 66: no users/groups matched Line: 67: incorrect codeowner user: lhez Line: 67: incorrect codeowner user: max-krasnyansky Line: 67: no users/groups matched Line: 68: incorrect codeowner user: max-krasnyansky Line: 68: incorrect codeowner user: lhez Line: 68: no users/groups matched Line: 69: incorrect codeowner user: JohannesGaessler Line: 69: no users/groups matched Line: 70: incorrect codeowner user: ggerganov Line: 70: no users/groups matched Line: 71: incorrect codeowner user: rgerganov Line: 71: no users/groups matched Line: 72: incorrect codeowner user: ggerganov Line: 72: incorrect codeowner user: slaren Line: 72: no users/groups matched Line: 73: incorrect codeowner user: 0cc4m Line: 73: no users/groups matched Line: 74: incorrect codeowner user: reeselevine Line: 74: no users/groups matched Line: 75: incorrect codeowner user: taronaeo Line: 75: incorrect codeowner user: Andreas-Krebbel Line: 75: incorrect codeowner user: AlekseiNikiforovIBM Line: 75: no users/groups matched Line: 76: incorrect codeowner user: ggerganov Line: 76: incorrect codeowner user: slaren Line: 76: no users/groups matched Line: 77: incorrect codeowner user: ggerganov Line: 77: incorrect codeowner user: slaren Line: 77: no users/groups matched Line: 78: incorrect codeowner user: JohannesGaessler Line: 78: incorrect codeowner user: Green-Sky Line: 78: no users/groups matched Line: 79: incorrect codeowner user: CISC Line: 79: no users/groups matched Line: 80: incorrect codeowner user: ggerganov Line: 80: no users/groups matched Line: 81: incorrect codeowner user: ggerganov Line: 81: no users/groups matched Line: 82: incorrect codeowner user: ggerganov Line: 82: no users/groups matched Line: 83: incorrect codeowner user: ggerganov Line: 83: no users/groups matched Line: 84: incorrect codeowner user: ggerganov Line: 84: no users/groups matched Line: 85: incorrect codeowner user: CISC Line: 85: no users/groups matched Line: 86: incorrect codeowner user: CISC Line: 86: no users/groups matched Line: 87: incorrect codeowner user: ngxson Line: 87: no users/groups matched Line: 88: incorrect codeowner user: CISC Line: 88: no users/groups matched Line: 89: incorrect codeowner user: slaren Line: 89: no users/groups matched Line: 90: incorrect codeowner user: CISC Line: 90: no users/groups matched Line: 91: incorrect codeowner user: CISC Line: 91: no users/groups matched Line: 92: incorrect codeowner user: ggerganov Line: 92: no users/groups matched Line: 93: incorrect codeowner user: slaren Line: 93: no users/groups matched Line: 94: incorrect codeowner user: slaren Line: 94: no users/groups matched Line: 95: incorrect codeowner user: ggerganov Line: 95: no users/groups matched Line: 96: incorrect codeowner user: slaren Line: 96: no users/groups matched Line: 97: incorrect codeowner user: ggerganov Line: 97: no users/groups matched Line: 98: incorrect codeowner user: ngxson Line: 98: no users/groups matched Line: 99: incorrect codeowner user: ggerganov Line: 99: no users/groups matched Line: 100: incorrect codeowner user: ggerganov Line: 100: no users/groups matched Line: 101: incorrect codeowner user: rgerganov Line: 101: no users/groups matched Line: 102: incorrect codeowner user: ericcurtin Line: 102: no users/groups matched Line: 103: incorrect codeowner user: ngxson Line: 103: incorrect codeowner user: ggerganov Line: 103: incorrect codeowner user: ericcurtin Line: 103: no users/groups matched Line: 104: incorrect codeowner user: allozaur Line: 104: no users/groups matched Line: 105: incorrect codeowner user: ggerganov Line: 105: no users/groups matched Line: 106: incorrect codeowner user: ggerganov Line: 106: no users/groups matched Line: 107: incorrect codeowner user: ggerganov Line: 107: no users/groups matched Line: 108: incorrect codeowner user: slaren Line: 108: no users/groups matched Line: 109: incorrect codeowner user: slaren Line: 109: no users/groups matched Line: 110: incorrect codeowner user: ggerganov Line: 110: no users/groups matched Line: 111: incorrect codeowner user: ggerganov Line: 111: no users/groups matched Line: 112: incorrect codeowner user: ggerganov Line: 112: no users/groups matched Line: 113: incorrect codeowner user: ggerganov Line: 113: no users/groups matched Line: 114: incorrect codeowner user: ggerganov Line: 114: no users/groups matched Line: 115: incorrect codeowner user: ggerganov Line: 115: no users/groups matched Line: 116: incorrect codeowner user: danbev Line: 116: no users/groups matched Line: 117: incorrect codeowner user: CISC Line: 117: no users/groups matched

Max Krasnyansky 3eb2be1ca5 Hexagon Op queue & dispatch optimizations (#16820) ...

* hexagon: remove dspqueue callbacks and do all read processing inplace

* hexagon: there is no need to ref/deref the buffers at this point

We're not going to release the buffers without flushing the session queue.
So there is no need to inc/dec the refcounts for every request.
We also don't need to include those bufs in the response.

* hexagon: bump the thread count in the adb wrapper scripts

We can use more CPU cores now that the dedicated dspqueue polling threads are not used (ie no contention).
Also enable more agressive polling for now since we still map Flash Attention (and a few other kernels) to
the CPU and those dspqueue threads were keeping the CPU cores are higher clock freqs.

* hexagon: add lhez as the second code owner

2025-10-29 06:29:12 -07:00

6.0 KiB

Raw Blame History

View Raw