提交 0f097f08 编写于 作者: Y Yishai Hadas 提交者: Jason Gunthorpe

lib/scatterlist: Fix to calculate the last_pg properly

The last_pg is wrong, it is actually the first page of the last
scatterlist element. To get the last page of the last scatterlist element
we have to add prv->length. So it is checking mergability against the
wrong page, Further, a SG element is not guaranteed to end on a page
boundary, so we have to check the sub page location also for merge
eligibility.

Fix the above by checking physical contiguity based on PFNs, compute the
actual last page and then call pages_are_mergable().

Fixes: 1567b49d ("lib/scatterlist: add check when merging zone device pages")
Link: https://lore.kernel.org/r/20230111101054.188136-1-yishaih@nvidia.comReported-by: NJason Gunthorpe <jgg@nvidia.com>
Signed-off-by: NYishai Hadas <yishaih@nvidia.com>
Reviewed-by: NChaitanya Kulkarni <kch@nvidia.com>
Signed-off-by: NJason Gunthorpe <jgg@nvidia.com>
上级 b3deec25
...@@ -470,22 +470,27 @@ int sg_alloc_append_table_from_pages(struct sg_append_table *sgt_append, ...@@ -470,22 +470,27 @@ int sg_alloc_append_table_from_pages(struct sg_append_table *sgt_append,
return -EOPNOTSUPP; return -EOPNOTSUPP;
if (sgt_append->prv) { if (sgt_append->prv) {
unsigned long next_pfn = (page_to_phys(sg_page(sgt_append->prv)) +
sgt_append->prv->offset + sgt_append->prv->length) / PAGE_SIZE;
if (WARN_ON(offset)) if (WARN_ON(offset))
return -EINVAL; return -EINVAL;
/* Merge contiguous pages into the last SG */ /* Merge contiguous pages into the last SG */
prv_len = sgt_append->prv->length; prv_len = sgt_append->prv->length;
last_pg = sg_page(sgt_append->prv); if (page_to_pfn(pages[0]) == next_pfn) {
while (n_pages && pages_are_mergeable(pages[0], last_pg)) { last_pg = pfn_to_page(next_pfn - 1);
if (sgt_append->prv->length + PAGE_SIZE > max_segment) while (n_pages && pages_are_mergeable(pages[0], last_pg)) {
break; if (sgt_append->prv->length + PAGE_SIZE > max_segment)
sgt_append->prv->length += PAGE_SIZE; break;
last_pg = pages[0]; sgt_append->prv->length += PAGE_SIZE;
pages++; last_pg = pages[0];
n_pages--; pages++;
n_pages--;
}
if (!n_pages)
goto out;
} }
if (!n_pages)
goto out;
} }
/* compute number of contiguous chunks */ /* compute number of contiguous chunks */
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册