aboutsummaryrefslogtreecommitdiffstats
path: root/io_uring
AgeCommit message (Expand)AuthorFilesLines
2022-12-19io_uring/net: fix cleanup after recyclePavel Begunkov1-1/+1
2022-12-19io_uring/net: ensure compat import handlers clear free_iovJens Axboe1-0/+1
2022-12-17io_uring: include task_work run after scheduling in wait for eventsJens Axboe1-1/+10
2022-12-17io_uring: don't use TIF_NOTIFY_SIGNAL to test for availability of task_workJens Axboe1-2/+1
2022-12-15io_uring: use call_rcu_hurry if signaling an eventfdDylan Yudaken1-1/+1
2022-12-15io_uring: fix overflow handling regressionPavel Begunkov2-2/+2
2022-12-14io_uring: ease timeout flush locking requirementsPavel Begunkov2-7/+4
2022-12-14io_uring: revise completion_lock lockingPavel Begunkov3-15/+20
2022-12-14io_uring: protect cq_timeouts with timeout_lockPavel Begunkov1-1/+3
2022-12-13Merge tag 'for-6.2/block-2022-12-08' of git://git.kernel.dk/linuxLinus Torvalds1-1/+2
2022-12-13Merge tag 'for-6.2/io_uring-next-2022-12-08' of git://git.kernel.dk/linuxLinus Torvalds10-190/+359
2022-12-13Merge tag 'for-6.2/io_uring-2022-12-08' of git://git.kernel.dk/linuxLinus Torvalds12-183/+291
2022-12-12Merge tag 'fs.idmapped.mnt_idmap.v6.2' of git://git.kernel.org/pub/scm/linux/...Linus Torvalds1-5/+3
2022-12-12Merge tag 'pull-iov_iter' of git://git.kernel.org/pub/scm/linux/kernel/git/vi...Linus Torvalds2-12/+12
2022-12-08io_uring/msg_ring: flag target ring as having task_work, if neededJens Axboe1-0/+1
2022-12-07io_uring: skip spinlocking for ->task_completePavel Begunkov2-20/+61
2022-12-07io_uring: do msg_ring in target task via twPavel Begunkov1-3/+53
2022-12-07io_uring: extract a io_msg_install_complete helperPavel Begunkov1-13/+21
2022-12-07io_uring: get rid of double lockingPavel Begunkov3-36/+51
2022-12-07io_uring: never run tw and fallback in parallelPavel Begunkov1-2/+10
2022-12-07io_uring: use tw for putting rsrcPavel Begunkov3-2/+19
2022-12-07io_uring: force multishot CQEs into task contextPavel Begunkov1-0/+21
2022-12-07io_uring: complete all requests in task contextPavel Begunkov1-3/+11
2022-12-07io_uring: don't check overflow flush failuresPavel Begunkov1-18/+6
2022-12-07io_uring: skip overflow CQE posting for dying ringPavel Begunkov1-14/+31
2022-12-07io_uring: improve io_double_lock_ctx fail handlingPavel Begunkov1-0/+2
2022-12-07io_uring: dont remove file from msg_ring reqsPavel Begunkov4-5/+10
2022-12-07io_uring: Fix a null-ptr-deref in io_tctx_exit_cb()Harshit Mogalapalli1-1/+3
2022-11-30io_uring: don't reinstall quiesce node for each twPavel Begunkov1-20/+18
2022-11-30io_uring: improve rsrc quiesce refs checksPavel Begunkov1-9/+6
2022-11-30io_uring: don't raw spin unlock to match cq_lockPavel Begunkov2-1/+6
2022-11-30io_uring: combine poll tw handlersPavel Begunkov1-33/+21
2022-11-30io_uring: improve poll warning handlingPavel Begunkov1-1/+1
2022-11-30io_uring: remove ctx variable in io_poll_check_eventsPavel Begunkov1-2/+1
2022-11-30io_uring: carve io_poll_check_events fast pathPavel Begunkov1-19/+22
2022-11-30io_uring: kill io_poll_issue's PF_EXITING checkPavel Begunkov1-2/+0
2022-11-29Merge branch 'for-6.2/io_uring' into for-6.2/io_uring-nextJens Axboe12-183/+291
2022-11-25use less confusing names for iov_iter direction initializersAl Viro2-12/+12
2022-11-25io_uring: clear TIF_NOTIFY_SIGNAL if set and task_work not availableJens Axboe1-2/+7
2022-11-25io_uring/poll: fix poll_refs race with cancelationLin Ma1-1/+2
2022-11-25io_uring/filetable: fix file reference underflowLin Ma1-2/+0
2022-11-25io_uring: make poll refs more robustPavel Begunkov1-1/+35
2022-11-25io_uring: cmpxchg for poll arm refs releasePavel Begunkov1-5/+3
2022-11-25io_uring: keep unlock_post inlined in hot pathPavel Begunkov1-2/+9
2022-11-25io_uring: don't use complete_post in kbufPavel Begunkov1-9/+5
2022-11-25io_uring: spelling fixDylan Yudaken1-1/+1
2022-11-25io_uring: remove io_req_complete_post_twDylan Yudaken2-8/+1
2022-11-25io_uring: allow multishot polled reqs to defer completionDylan Yudaken1-1/+2
2022-11-25io_uring: remove overflow param from io_post_aux_cqeDylan Yudaken4-10/+13
2022-11-25io_uring: add lockdep assertion in io_fill_cqe_auxDylan Yudaken1-0/+2
2022-11-25io_uring: make io_fill_cqe_aux staticDylan Yudaken2-4/+2
2022-11-25io_uring: add io_aux_cqe which allows deferred completionDylan Yudaken4-5/+42
2022-11-25io_uring: allow defer completion for aux posted cqesDylan Yudaken1-3/+24
2022-11-25io_uring: defer all io_req_complete_failedDylan Yudaken3-11/+10
2022-11-25io_uring: always lock in io_apoll_task_funcDylan Yudaken1-1/+2
2022-11-23io_uring: remove iopoll spinlockPavel Begunkov1-3/+2
2022-11-23io_uring: iopoll protect complete_postPavel Begunkov5-12/+27
2022-11-23io_uring: inline __io_req_complete_put()Pavel Begunkov1-13/+7
2022-11-23io_uring: remove io_req_tw_post_queuePavel Begunkov3-16/+10
2022-11-23io_uring: use io_req_task_complete() in timeoutPavel Begunkov1-2/+2
2022-11-23io_uring: hold locks for io_req_complete_failedPavel Begunkov1-1/+5
2022-11-23io_uring: add completion locking for iopollPavel Begunkov1-2/+3
2022-11-22io_uring: kill io_cqring_ev_posted() and __io_cq_unlock_post()Jens Axboe1-13/+4
2022-11-22Revert "io_uring: disallow self-propelled ring polling"Jens Axboe1-2/+0
2022-11-22io_uring: pass in EPOLL_URING_WAKE for eventfd signaling and wakeupsJens Axboe3-6/+21
2022-11-21io_uring: inline __io_req_complete_post()Pavel Begunkov2-9/+3
2022-11-21io_uring: split tw fallback into a functionPavel Begunkov1-10/+15
2022-11-21io_uring: inline io_req_task_work_add()Pavel Begunkov2-7/+7
2022-11-21io_uring: update outdated comment of callbacksLin Ma1-1/+1
2022-11-21io_uring/poll: remove outdated comments of cachingLin Ma1-6/+1
2022-11-21io_uring: allow multishot recv CQEs to overflowDylan Yudaken1-6/+2
2022-11-21io_uring: revert "io_uring fix multishot accept ordering"Dylan Yudaken1-4/+4
2022-11-21io_uring: do not always force run task_work in io_uring_registerDylan Yudaken2-3/+6
2022-11-21io_uring: fix two assignments in if conditionsXinghui Li2-9/+14
2022-11-21io_uring/net: move mm accounting to a slower pathPavel Begunkov2-18/+16
2022-11-21io_uring: move zc reporting from the hot pathPavel Begunkov3-12/+42
2022-11-21io_uring/net: inline io_notif_flush()Pavel Begunkov2-11/+10
2022-11-21io_uring/net: rename io_uring_tx_zerocopy_callbackPavel Begunkov1-4/+3
2022-11-21io_uring/net: preset notif tw handlerPavel Begunkov1-6/+3
2022-11-21io_uring/net: remove extra notif rsrc setupPavel Begunkov1-1/+0
2022-11-21io_uring: move kbuf put out of generic tw completePavel Begunkov2-6/+6
2022-11-21io_uring/net: introduce IORING_SEND_ZC_REPORT_USAGE flagStefan Metzmacher3-1/+20
2022-11-18io_uring: disallow self-propelled ring pollingPavel Begunkov1-0/+2
2022-11-17io_uring: fix multishot recv request leaksPavel Begunkov1-9/+7
2022-11-17io_uring: fix multishot accept request leaksPavel Begunkov3-8/+5
2022-11-17io_uring: fix tw losing poll eventsPavel Begunkov1-0/+7
2022-11-17io_uring: update res mask in io_poll_check_eventsPavel Begunkov1-0/+3
2022-11-16io_uring/rw: enable bio caches for IRQ rwPavel Begunkov1-1/+2
2022-11-11io_uring/poll: lockdep annote io_poll_req_insert_lockedPavel Begunkov1-0/+2
2022-11-11io_uring/poll: fix double poll req->flags racesPavel Begunkov1-12/+17
2022-11-10io_uring: check for rollover of buffer ID when providing buffersJens Axboe1-0/+2
2022-11-08io_uring: calculate CQEs from the user visible valueDylan Yudaken1-2/+8
2022-10-31acl: conver higher-level helpers to rely on mnt_idmapChristian Brauner1-5/+3
2022-10-27io_uring: unlock if __io_run_local_work locked insideDylan Yudaken2-6/+15
2022-10-27io_uring: use io_run_local_work_locked helperDylan Yudaken1-2/+1
2022-10-22io_uring/net: fail zc sendmsg when unsupported by socketPavel Begunkov1-0/+2
2022-10-22io_uring/net: fail zc send when unsupported by socketPavel Begunkov1-0/+2
2022-10-20io-wq: Fix memory leak in worker creationRafael Mendonca1-1/+1
2022-10-19io_uring/msg_ring: Fix NULL pointer dereference in io_msg_send_fd()Harshit Mogalapalli1-0/+3
2022-10-16io_uring/rw: remove leftover debug statementJens Axboe1-2/+0
2022-10-16io_uring: don't iopoll from io_ring_ctx_wait_and_kill()Pavel Begunkov1-8/+5
2022-10-16io_uring: reuse io_alloc_req()Pavel Begunkov1-6/+2
2022-10-16io_uring: kill hot path fixed file bitmap debug checksPavel Begunkov2-1/+1
2022-10-16io_uring: remove FFS_SCMPavel Begunkov4-25/+3
2022-10-12io_uring/rw: ensure kiocb_end_write() is always calledJens Axboe1-9/+29
2022-10-12io_uring: fix fdinfo sqe offsets calculationPavel Begunkov1-1/+1
2022-10-12io_uring: local variable rw shadows outer variable in io_writeStefan Roesch1-4/+4
2022-10-12io_uring/opdef: remove 'audit_skip' from SENDMSG_ZCJens Axboe1-1/+0
2022-10-12io_uring: optimise locking for local tw with submit_waitPavel Begunkov2-2/+17
2022-10-12io_uring: remove redundant memory barrier in io_req_local_work_addPavel Begunkov2-4/+12
2022-10-12io_uring/net: handle -EINPROGRESS correct for IORING_OP_CONNECTJens Axboe1-6/+22
2022-10-12io_uring: remove notif leftoversPavel Begunkov1-1/+0
2022-10-12io_uring: correct pinned_vm accountingPavel Begunkov1-6/+4
2022-10-12io_uring/af_unix: defer registered files gc to io_uring releasePavel Begunkov1-0/+1
2022-10-07io_uring: limit registration w/ SINGLE_ISSUERPavel Begunkov1-0/+3
2022-10-07io_uring: remove io_register_submitterDylan Yudaken1-19/+3
2022-10-07io_uring: simplify __io_uring_add_tctx_nodeDylan Yudaken3-13/+25
2022-10-07Merge tag 'for-6.1/passthrough-2022-10-04' of git://git.kernel.dk/linuxLinus Torvalds1-1/+28
2022-10-07Merge tag 'for-6.1/block-2022-10-03' of git://git.kernel.dk/linuxLinus Torvalds1-1/+1
2022-10-07Merge tag 'for-6.1/io_uring-2022-10-03' of git://git.kernel.dk/linuxLinus Torvalds15-304/+707
2022-10-06Merge tag 'pull-path' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfsLinus Torvalds1-1/+1
2022-09-30Merge tag 'io_uring-6.0-2022-09-29' of git://git.kernel.dk/linuxLinus Torvalds2-1/+8
2022-09-30io_uring: introduce fixed buffer support for io_uring_cmdAnuj Gupta1-1/+18
2022-09-30io_uring: add io_uring_cmd_import_fixedAnuj Gupta1-0/+10
2022-09-30Merge branch 'for-6.1/io_uring' into for-6.1/passthroughJens Axboe15-304/+707
2022-09-30Merge branch 'for-6.1/block' into for-6.1/passthroughJens Axboe1-1/+1
2022-09-29io_uring/net: fix notif cqe reorderingPavel Begunkov1-5/+19
2022-09-29io_uring/net: don't update msg_name if not providedPavel Begunkov1-1/+2
2022-09-29io_uring: don't gate task_work run on TIF_NOTIFY_SIGNALJens Axboe1-4/+4
2022-09-29io_uring/rw: defer fsnotify calls to task contextJens Axboe1-9/+15
2022-09-29io_uring/net: fix fast_iov assignment in io_setup_async_msg()Stefan Metzmacher1-2/+4
2022-09-28io_uring/net: fix non-zc send with addressPavel Begunkov1-6/+6
2022-09-28io_uring/poll: disable level triggered pollJens Axboe1-1/+1
2022-09-28io_uring/net: don't skip notifs for failed requestsPavel Begunkov1-21/+8
2022-09-27block: replace blk_queue_nowait with bdev_nowaitChristoph Hellwig1-1/+1
2022-09-26io_uring/rw: don't lose short results on io_setup_async_rw()Pavel Begunkov1-3/+5
2022-09-26io_uring/rw: fix unexpected link breakagePavel Begunkov1-0/+1
2022-09-26io_uring: register single issuer task at creationDylan Yudaken1-0/+7
2022-09-26io_uring/net: fix cleanup double free free_iov initPavel Begunkov1-10/+10
2022-09-24Merge tag 'io_uring-6.0-2022-09-23' of git://git.kernel.dk/linuxLinus Torvalds1-0/+3
2022-09-23io_uring: ensure that cached task references are always put on exitJens Axboe1-0/+3
2022-09-23io_uring: fix CQE reorderingPavel Begunkov2-5/+19
2022-09-23io_uring/net: fix UAF in io_sendrecv_fail()Pavel Begunkov1-10/+5
2022-09-21io_uring: ensure local task_work marks task as runningJens Axboe1-0/+1
2022-09-21io_uring/net: zerocopy sendmsgPavel Begunkov3-5/+106
2022-09-21io_uring/net: combine fail handlersPavel Begunkov3-17/+17
2022-09-21io_uring/net: rename io_sendzc()Pavel Begunkov3-9/+9
2022-09-21io_uring/net: support non-zerocopy sendtoPavel Begunkov3-8/+35
2022-09-21io_uring/net: refactor io_setup_async_addrPavel Begunkov1-9/+9
2022-09-21io_uring/net: don't lose partial send_zc on failPavel Begunkov3-0/+18
2022-09-21io_uring/net: don't lose partial send/recv on failPavel Begunkov3-0/+16
2022-09-21io_uring/rw: don't lose partial IO result on failPavel Begunkov3-0/+15
2022-09-21io_uring: add custom opcode hooks on failPavel Begunkov2-0/+5
2022-09-21io_uring/fdinfo: fix sqe dumping for IORING_SETUP_SQE128Jens Axboe1-6/+26
2022-09-21io_uring/fdinfo: get rid of unnecessary is_cqe32 variableJens Axboe1-10/+6
2022-09-21io_uring: remove unused return from io_disarm_nextPavel Begunkov2-11/+4
2022-09-21io_uring: add fast path for io_run_local_work()Pavel Begunkov1-0/+3
2022-09-21io_uring/iopoll: unify tw breaking logicPavel Begunkov1-7/+7
2022-09-21io_uring/iopoll: fix unexpected returnsPavel Begunkov1-4/+1
2022-09-21io_uring: disallow defer-tw run w/ no submittersPavel Begunkov2-13/+3
2022-09-21io_uring: further limit non-owner defer-tw cq waitingPavel Begunkov2-0/+17
2022-09-21io_uring/net: use io_sr_msg for sendzcPavel Begunkov1-13/+5
2022-09-21io_uring/net: refactor io_sr_msg typesPavel Begunkov1-7/+7
2022-09-21io_uring/net: add non-bvec sg chunking callbackPavel Begunkov1-6/+11
2022-09-21io_uring/net: io_async_msghdr caches for sendzcPavel Begunkov1-5/+4
2022-09-21io_uring/net: use async caches for async prepPavel Begunkov2-3/+15
2022-09-21io_uring/net: reshuffle error handlingPavel Begunkov1-8/+8
2022-09-21io_uring: use io_cq_lock consistentlyPavel Begunkov1-1/+1
2022-09-21io_uring: kill an outdated commentPavel Begunkov1-4/+0
2022-09-21io_uring: allow buffer recycling in READVDylan Yudaken2-94/+52
2022-09-21fs: add batch and poll flags to the uring_cmd_iopoll() handlerJens Axboe1-1/+2
2022-09-21io_uring: ensure iopoll runs local task work as wellJens Axboe2-19/+26
2022-09-21io_uring: add local task_work run helper that is entered lockedJens Axboe2-7/+17
2022-09-21io_uring: cleanly separate request types for iopollJens Axboe1-6/+9
2022-09-21io_uring: add iopoll infrastructure for io_uring_cmdKanchan Joshi4-3/+23
2022-09-21io_uring: trace local task work runDylan Yudaken1-0/+3
2022-09-21io_uring: signal registered eventfd to process deferred task workDylan Yudaken1-23/+61
2022-09-21io_uring: move io_eventfd_putDylan Yudaken1-8/+8
2022-09-21io_uring: add IORING_SETUP_DEFER_TASKRUNDylan Yudaken4-21/+159
2022-09-21io_uring: do not run task work at the start of io_uring_enterDylan Yudaken1-2/+0
2022-09-21io_uring: introduce io_has_workDylan Yudaken1-4/+9
2022-09-21io_uring: remove unnecessary variableDylan Yudaken1-4/+1
2022-09-18Merge tag 'io_uring-6.0-2022-09-18' of git://git.kernel.dk/linuxLinus Torvalds2-9/+9
2022-09-18io_uring/opdef: rename SENDZC_NOTIF to SEND_ZCStefan Metzmacher1-1/+1
2022-09-18io_uring/net: fix zc fixed buf lifetimePavel Begunkov1-8/+8
2022-09-16Merge tag 'io_uring-6.0-2022-09-16' of git://git.kernel.dk/linux-blockLinus Torvalds2-2/+3
2022-09-15io_uring/msg_ring: check file type before puttingJens Axboe1-1/+2
2022-09-13io_uring/rw: fix error'ed retry return valuesPavel Begunkov1-1/+1
2022-09-09Merge tag 'io_uring-6.0-2022-09-09' of git://git.kernel.dk/linux-blockLinus Torvalds5-25/+29
2022-09-09io_uring/rw: fix short rw error handlingPavel Begunkov1-12/+18
2022-09-08io_uring/net: copy addr for zc on POLL_FIRSTPavel Begunkov1-3/+4
2022-09-07io_uring: recycle kbuf recycle on tw requeuePavel Begunkov1-0/+1
2022-09-07io_uring/kbuf: fix not advancing READV kbuf ringPavel Begunkov1-2/+6
2022-09-05io_uring/notif: Remove the unused function io_notif_complete()Jiapeng Chong1-8/+0
2022-09-02Merge tag 'io_uring-6.0-2022-09-02' of git://git.kernel.dk/linux-blockLinus Torvalds8-230/+52
2022-09-01__io_setxattr(): constify pathAl Viro1-1/+1
2022-09-01io_uring/net: simplify zerocopy send user APIPavel Begunkov6-74/+42
2022-09-01io_uring/notif: remove notif registrationPavel Begunkov4-95/+1
2022-09-01Revert "io_uring: rename IORING_OP_FILES_UPDATE"Pavel Begunkov3-22/+8
2022-09-01Revert "io_uring: add zc notification flush requests"Pavel Begunkov1-38/+0