aboutsummaryrefslogtreecommitdiffstats
path: root/io_uring
AgeCommit message (Expand)AuthorFilesLines
2023-05-25io_uring: unlock sqd->lock before sq thread release CPUWenwen Chen1-1/+5
2023-05-07Merge tag 'for-6.4/io_uring-2023-05-07' of git://git.kernel.dk/linuxLinus Torvalds5-19/+20
2023-05-04io_uring: Remove unnecessary BUILD_BUG_ONBreno Leitao2-11/+0
2023-05-04io_uring: Pass whole sqe to commandsBreno Leitao2-7/+4
2023-05-04io_uring: Create a helper to return the SQE sizeBreno Leitao1-0/+10
2023-05-03io_uring/rsrc: check for nonconsecutive pagesTobias Holl1-1/+6
2023-04-26Merge tag 'net-next-6.4' of git://git.kernel.org/pub/scm/linux/kernel/git/net...Linus Torvalds1-2/+1
2023-04-26Merge tag 'for-6.4/block-2023-04-21' of git://git.kernel.dk/linuxLinus Torvalds1-1/+1
2023-04-26Merge tag 'for-6.4/io_uring-2023-04-21' of git://git.kernel.dk/linuxLinus Torvalds16-813/+902
2023-04-24Merge tag 'iter-ubuf.2-2023-04-21' of git://git.kernel.dk/linuxLinus Torvalds2-20/+19
2023-04-20Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/netJakub Kicinski1-1/+1
2023-04-20Revert "io_uring/rsrc: disallow multi-source reg buffers"Jens Axboe1-8/+5
2023-04-18io_uring: add support for multishot timeoutsDavid Wei1-3/+54
2023-04-18io_uring/rsrc: disassociate nodes and rsrc_dataPavel Begunkov2-12/+11
2023-04-18io_uring/rsrc: devirtualise rsrc put callbacksPavel Begunkov2-7/+20
2023-04-18io_uring/rsrc: pass node to io_rsrc_put_work()Pavel Begunkov1-6/+6
2023-04-18io_uring/rsrc: inline io_rsrc_put_work()Pavel Begunkov2-14/+6
2023-04-18io_uring/rsrc: add empty flag in rsrc_nodePavel Begunkov2-4/+4
2023-04-18io_uring/rsrc: merge nodes and io_rsrc_putPavel Begunkov3-97/+25
2023-04-18io_uring/rsrc: infer node from ctx on io_queue_rsrc_removalPavel Begunkov3-9/+8
2023-04-18io_uring/rsrc: remove unused io_rsrc_node::llistPavel Begunkov1-1/+0
2023-04-15io_uring/rsrc: refactor io_queue_rsrc_removalPavel Begunkov1-4/+1
2023-04-15io_uring/rsrc: simplify single file node switchingPavel Begunkov1-7/+4
2023-04-15io_uring/rsrc: clean up __io_sqe_buffers_update()Pavel Begunkov1-2/+1
2023-04-15io_uring/rsrc: inline switch_start fast pathPavel Begunkov2-8/+13
2023-04-15io_uring/rsrc: remove rsrc_data refsPavel Begunkov3-28/+10
2023-04-15io_uring/rsrc: fix DEFER_TASKRUN rsrc quiescePavel Begunkov1-0/+9
2023-04-15io_uring/rsrc: use wq for quiescingPavel Begunkov3-7/+13
2023-04-15io_uring/rsrc: refactor io_rsrc_ref_quiescePavel Begunkov1-13/+5
2023-04-15io_uring/rsrc: remove io_rsrc_node::donePavel Begunkov2-5/+1
2023-04-15io_uring/rsrc: use nospec'ed indexesPavel Begunkov1-1/+1
2023-04-15io_uring/notif: add constant for ubuf_info flagsPavel Begunkov2-1/+2
2023-04-15Merge tag 'io_uring-6.3-2023-04-14' of git://git.kernel.dk/linuxLinus Torvalds1-1/+1
2023-04-14io_uring: complete request via task work in case of DEFER_TASKRUNMing Lei1-1/+1
2023-04-13Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/netJakub Kicinski2-4/+5
2023-04-12io_uring/rsrc: extract SCM file put helperPavel Begunkov1-9/+11
2023-04-12io_uring/rsrc: refactor io_rsrc_node_switchPavel Begunkov3-28/+20
2023-04-12io_uring/rsrc: zero node's rsrc data on allocPavel Begunkov1-0/+1
2023-04-12io_uring/rsrc: consolidate node cachingPavel Begunkov3-11/+16
2023-04-12io_uring/rsrc: add lockdep checksPavel Begunkov1-0/+2
2023-04-12io_uring: add irq lockdep checksPavel Begunkov1-0/+2
2023-04-12io_uring/kbuf: remove extra ->buf_ring null checkPavel Begunkov1-8/+6
2023-04-12io_uring: shut io_prep_async_work warningPavel Begunkov1-1/+1
2023-04-12io_uring/uring_cmd: take advantage of completion batchingJens Axboe1-3/+7
2023-04-08Merge tag 'io_uring-6.3-2023-04-06' of git://git.kernel.dk/linuxLinus Torvalds2-4/+5
2023-04-06io_uring: optimise io_req_local_work_addPavel Begunkov1-8/+16
2023-04-06io_uring: refactor __io_cq_unlock_post_flush()Pavel Begunkov1-10/+12
2023-04-06io_uring: reduce scheduling due to twPavel Begunkov5-24/+59
2023-04-06io_uring: inline llist_add()Pavel Begunkov1-1/+8
2023-04-06io_uring: add tw add flagsPavel Begunkov2-5/+11
2023-04-06io_uring: refactor io_cqring_wake()Pavel Begunkov2-13/+4
2023-04-06io_uring: optimize local tw add ctx pinningPavel Begunkov1-2/+6
2023-04-06io_uring: move pinning out of io_req_local_work_addPavel Begunkov1-7/+4
2023-04-06Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/netJakub Kicinski3-7/+7
2023-04-05io_uring/uring_cmd: assign ioucmd->cmd at async prep timeJens Axboe1-3/+1
2023-04-04io_uring/rsrc: add custom limit for node cachingPavel Begunkov3-5/+12
2023-04-04io_uring/rsrc: optimise io_rsrc_data refcountingPavel Begunkov2-13/+19
2023-04-04io_uring/rsrc: add lockdep sanity checksPavel Begunkov3-5/+7
2023-04-04io_uring/rsrc: cache struct io_rsrc_nodePavel Begunkov3-12/+31
2023-04-04io_uring/rsrc: don't offload node freePavel Begunkov2-61/+4
2023-04-04io_uring/rsrc: optimise io_rsrc_put allocationPavel Begunkov2-17/+36
2023-04-04io_uring/rsrc: rename rsrc_listPavel Begunkov2-4/+10
2023-04-04io_uring/rsrc: kill rsrc_ref_lockPavel Begunkov2-6/+0
2023-04-04io_uring/rsrc: protect node refs with uring_lockPavel Begunkov3-56/+21
2023-04-04io_uring: io_free_req() via twPavel Begunkov1-1/+7
2023-04-04io_uring: don't put nodes under spinlocksPavel Begunkov2-5/+8
2023-04-04io_uring/rsrc: keep cached refs per nodePavel Begunkov2-13/+18
2023-04-04io_uring/rsrc: use non-pcpu refcounts for nodesPavel Begunkov2-12/+9
2023-04-03io_uring: cap io_sqring_entries() at SQ ring sizeJens Axboe2-2/+4
2023-04-03io_uring: rename trace_io_uring_submit_sqe() tracepointJens Axboe1-2/+1
2023-04-03io_uring: encapsulate task_work statePavel Begunkov7-72/+73
2023-04-03io_uring: remove extra tw trylocksPavel Begunkov1-2/+1
2023-04-03io_uring/io-wq: drop outdated commentJens Axboe1-5/+1
2023-04-03io-wq: Drop struct io_wqeGabriel Krisman Bertazi1-188/+156
2023-04-03io-wq: Move wq accounting to io_wqGabriel Krisman Bertazi1-38/+40
2023-04-03io_uring/kbuf: disallow mapping a badly aligned provided ring bufferJens Axboe1-0/+18
2023-04-03io_uring: Add KASAN support for alloc_cachesBreno Leitao3-4/+11
2023-04-03io_uring: Move from hlist to io_wq_work_nodeBreno Leitao1-11/+13
2023-04-03io_uring: One wqe per wqBreno Leitao1-110/+70
2023-04-03io_uring: add support for user mapped provided buffer ringJens Axboe3-24/+92
2023-04-03io_uring/kbuf: rename struct io_uring_buf_reg 'pad' to'flags'Jens Axboe1-2/+6
2023-04-03io_uring/kbuf: add buffer_list->is_mapped memberJens Axboe2-6/+11
2023-04-03io_uring/kbuf: move pinning of provided buffer ring into helperJens Axboe1-12/+25
2023-04-03io_uring: Adjust mapping wrt architecture aliasing requirementsHelge Deller1-0/+51
2023-04-03io_uring: avoid hashing O_DIRECT writes if the filesystem doesn't need itJens Axboe1-1/+7
2023-04-01io_uring: fix memory leak when removing provided buffersWojciech Lukowicz2-2/+5
2023-04-01io_uring: fix return value when removing provided buffersWojciech Lukowicz1-2/+0
2023-03-31Merge tag 'io_uring-6.3-2023-03-30' of git://git.kernel.dk/linuxLinus Torvalds3-7/+7
2023-03-30Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/netJakub Kicinski4-13/+26
2023-03-30iov_iter: add iter_iov_addr() and iter_iov_len() helpersJens Axboe1-14/+13
2023-03-30iov_iter: add iter_iovec() helperJens Axboe2-6/+6
2023-03-30io_uring: fix poll/netmsg alloc cachesPavel Begunkov1-0/+1
2023-03-29io_uring/rsrc: fix rogue rsrc node grabbingPavel Begunkov1-7/+5
2023-03-28io_uring/poll: clear single/double poll flags on poll armingJens Axboe1-0/+1
2023-03-24Merge tag 'block-6.3-2023-03-24' of git://git.kernel.dk/linuxLinus Torvalds1-4/+6
2023-03-22io_uring/rsrc: fix null-ptr-deref in io_file_bitmap_get()Savino Dicanosa2-0/+4
2023-03-20io_uring/net: avoid sending -ECONNABORTED on repeated connection requestsJens Axboe1-9/+16
2023-03-20block/io_uring: pass in issue_flags for uring_cmd task_work handlingJens Axboe1-4/+6
2023-03-20blk-mq: remove hybrid pollingKeith Busch1-1/+1
2023-03-17Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/netJakub Kicinski7-13/+31
2023-03-16io_uring/rsrc: fix folio accountingPavel Begunkov1-1/+7
2023-03-16io_uring/msg_ring: let target know allocated indexPavel Begunkov1-1/+3
2023-03-15io_uring: rsrc: Optimize return value variable 'ret'Li zeming1-1/+1
2023-03-15io_uring/sqpoll: Do not set PF_NO_SETAFFINITY on sqpoll threadsMichal Koutný1-1/+0
2023-03-09Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/netJakub Kicinski9-64/+85
2023-03-09io_uring: silence variable ‘prev’ set but not used warningJens Axboe2-3/+6
2023-03-09io_uring/uring_cmd: ensure that device supports IOPOLLJens Axboe1-1/+3
2023-03-08io_uring/io-wq: stop setting PF_NO_SETAFFINITY on io-wq workersJens Axboe1-5/+11
2023-03-08net: reclaim skb->scm_io_uring bitEric Dumazet1-2/+1
2023-03-03Merge tag 'io_uring-6.3-2023-03-03' of git://git.kernel.dk/linuxLinus Torvalds8-61/+84
2023-03-01capability: just use a 'u64' instead of a 'u32[2]' arrayLinus Torvalds1-3/+1
2023-03-01io_uring/poll: don't pass in wake func to io_init_poll_iocb()Jens Axboe1-5/+7
2023-02-28io_uring: fix fget leak when fs don't support nowait buffered readJoseph Qi1-1/+1
2023-02-25io_uring/poll: allow some retries for poll triggering spuriouslyJens Axboe2-2/+13
2023-02-24io_uring: remove MSG_NOSIGNAL from recvmsgDavid Lamparter1-1/+1
2023-02-24io_uring/rsrc: always initialize 'folio' to NULLJens Axboe1-1/+1
2023-02-23Merge tag 'mm-stable-2023-02-20-13-37' of git://git.kernel.org/pub/scm/linux/...Linus Torvalds1-1/+1
2023-02-22io_uring/rsrc: optimise registered huge pagesPavel Begunkov1-6/+32
2023-02-22io_uring/rsrc: optimise single entry advancePavel Begunkov1-1/+4
2023-02-22io_uring/rsrc: disallow multi-source reg buffersPavel Begunkov1-5/+8
2023-02-22io_uring: remove unused wq_list_mergePavel Begunkov1-22/+0
2023-02-22io_uring: fix size calculation when registering buf ringWojciech Lukowicz1-1/+1
2023-02-22io_uring/rsrc: fix a comment in io_import_fixed()Pavel Begunkov1-1/+1
2023-02-22io_uring: rename 'in_idle' to 'in_cancel'Jens Axboe2-10/+10
2023-02-22io_uring: consolidate the put_ref-and-return section of adding workJens Axboe1-6/+6
2023-02-20Merge tag 'for-6.3/block-2023-02-16' of git://git.kernel.dk/linuxLinus Torvalds1-3/+1
2023-02-20Merge tag 'for-6.3/iter-ubuf-2023-02-16' of git://git.kernel.dk/linuxLinus Torvalds2-15/+11
2023-02-16io_uring: Support calling io_uring_register with a registered ring fdJosh Triplett1-7/+26
2023-02-10io_uring,audit: don't log IORING_OP_MADVISERichard Guy Briggs1-0/+1
2023-02-06io_uring: mark task TASK_RUNNING before handling resume/task workJens Axboe1-1/+3
2023-02-03io_uring: use bvec_set_page to initialize a bvecChristoph Hellwig1-3/+1
2023-01-29io_uring: always go async for unsupported open flagsDylan Yudaken1-6/+12
2023-01-29io_uring: always go async for unsupported fadvise flagsDylan Yudaken1-10/+15
2023-01-29io_uring: for requests that require async, force itDylan Yudaken7-34/+33
2023-01-29io_uring: if a linked request has REQ_F_FORCE_ASYNC then run it asyncDylan Yudaken1-3/+5
2023-01-29io_uring: add reschedule point to handle_tw_list()Jens Axboe1-1/+7
2023-01-29io_uring: add a conditional reschedule to the IOPOLL cancelation loopJens Axboe1-0/+1
2023-01-29io_uring: return normal tw run linking optimisationPavel Begunkov1-0/+9
2023-01-29io_uring: refactor tctx_task_workPavel Begunkov1-8/+5
2023-01-29io_uring: refactor io_put_task helpersPavel Begunkov1-5/+12
2023-01-29io_uring: refactor req allocationPavel Begunkov3-14/+15
2023-01-29io_uring: improve io_get_sqePavel Begunkov1-5/+5
2023-01-29io_uring: kill outdated comment about overflow flushPavel Begunkov1-1/+0
2023-01-29io_uring: use user visible tail in io_uring_poll()Pavel Begunkov1-1/+1
2023-01-29io_uring: pass in io_issue_def to io_assign_file()Jens Axboe1-4/+5
2023-01-29io_uring: Enable KASAN for request cacheBreno Leitao2-4/+10
2023-01-29io_uring: handle TIF_NOTIFY_RESUME when checking for task_workJens Axboe1-0/+8
2023-01-29io_uring/msg-ring: ensure flags passing works for task_work completionsJens Axboe1-1/+6
2023-01-29io_uring: Split io_issue_def structBreno Leitao4-115/+238
2023-01-29io_uring: Rename struct io_op_defBreno Leitao5-25/+25
2023-01-29io_uring: refactor __io_req_complete_postPavel Begunkov1-2/+2
2023-01-29io_uring: simplify fallback executionPavel Begunkov1-8/+6
2023-01-29io_uring: don't export io_put_task()Pavel Begunkov2-11/+10
2023-01-29io_uring: return back links tw run optimisationPavel Begunkov1-1/+4
2023-01-29io_uring: make io_sqpoll_wait_sq return voidQuanfa Fu3-8/+5
2023-01-29io_uring: optimise deferred tw executionPavel Begunkov1-17/+7
2023-01-29io_uring: add io_req_local_work_add wake fast pathPavel Begunkov1-1/+6
2023-01-29io_uring: waitqueue-less cq waitingPavel Begunkov1-7/+12
2023-01-29io_uring: wake up optimisationsPavel Begunkov1-1/+20
2023-01-29io_uring: add lazy poll_wq activationPavel Begunkov2-5/+62
2023-01-29io_uring: separate wq for ring pollingPavel Begunkov2-1/+11
2023-01-29io_uring: move io_run_local_work_lockedPavel Begunkov2-18/+17
2023-01-29io_uring: mark io_run_local_work staticPavel Begunkov2-2/+1
2023-01-29io_uring: don't set TASK_RUNNING in local tw runnerPavel Begunkov1-3/+2
2023-01-29io_uring: refactor io_wake_functionPavel Begunkov1-4/+2
2023-01-29io_uring: remove excessive unlikely on IS_ERRDmitrii Bundin1-1/+1
2023-01-29io_uring/msg_ring: Pass custom flags to the cqeBreno Leitao1-5/+19
2023-01-29io_uring: keep timeout in io_wait_queuePavel Begunkov1-14/+14
2023-01-29io_uring: optimise non-timeout waitingPavel Begunkov1-1/+3
2023-01-29io_uring: set TASK_RUNNING right after schedulePavel Begunkov1-3/+2
2023-01-29io_uring: simplify io_has_workPavel Begunkov1-2/+1
2023-01-29io_uring: mimimise io_cqring_wait_schedulePavel Begunkov1-16/+23
2023-01-29io_uring: parse check_cq out of wq waitingPavel Begunkov1-14/+18
2023-01-29io_uring: move defer tw task checksPavel Begunkov2-9/+11
2023-01-29io_uring: kill io_run_task_work_ctxPavel Begunkov2-21/+5
2023-01-29io_uring: don't iterate cq wait fast pathPavel Begunkov1-10/+8
2023-01-29io_uring: rearrange defer list checksPavel Begunkov2-4/+1
2023-01-27io_uring: always prep_async for drain requestsDylan Yudaken1-10/+8
2023-01-23io_uring/net: cache provided buffer group value for multishot receivesJens Axboe1-0/+11
2023-01-20io_uring/poll: don't reissue in case of poll race on multishot requestJens Axboe1-1/+5
2023-01-20io_uring/msg_ring: fix remote queue to disabled ringPavel Begunkov2-2/+10
2023-01-20io_uring/msg_ring: fix flagging remote executionPavel Begunkov1-17/+23
2023-01-19io_uring/msg_ring: fix missing lock on overflow for IOPOLLJens Axboe1-9/+30
2023-01-19io_uring/msg_ring: move double lock/unlock helpers higher upJens Axboe1-24/+23
2023-01-18mm/nommu: factor out check for NOMMU shared mappings into is_nommu_shared_map...David Hildenbrand1-1/+1
2023-01-13io_uring: lock overflowing for IOPOLLPavel Begunkov1-1/+5
2023-01-12io_uring/poll: attempt request issue after racy poll wakeupJens Axboe1-11/+20
2023-01-10io_uring/fdinfo: include locked hash table in fdinfo outputJens Axboe1-2/+10
2023-01-09io_uring/poll: add hash if ready poll request can't complete inlineJens Axboe1-5/+12
2023-01-08io_uring: use iter_ubuf for single range importsJens Axboe1-3/+6
2023-01-08io_uring: switch network send/recv to ITER_UBUFJens Axboe1-12/+5
2023-01-08io_uring/io-wq: only free worker if it was allocated for creationJens Axboe1-1/+6
2023-01-05io_uring: fix CQ waiting timeout handlingPavel Begunkov1-3/+3
2023-01-03io_uring: lockdep annotate CQ lockingPavel Begunkov2-3/+17
2023-01-03io_uring: pin context while queueing deferred twPavel Begunkov1-1/+7
2023-01-02io_uring/io-wq: free worker if task_work creation is canceledJens Axboe1-0/+1
2022-12-23io_uring: check for valid register opcode earlierJens Axboe1-2/+3
2022-12-21io_uring/cancel: re-grab ctx mutex after finishing waitJens Axboe1-5/+4
2022-12-21io_uring: finish waiting before flushing overflow entriesJens Axboe1-9/+16
2022-12-19io_uring/net: fix cleanup after recyclePavel Begunkov1-1/+1