Skip to content

cloud-kernel
cloud-kernel

openanolis / cloud-kernel
1 年多 前同步成功

通知 163
Star 36
Fork 7
cloud-kernel
cloud-kernel
切换分支/标签
  1. 14 8月, 2009 1 次提交
  3. 24 7月, 2009 2 次提交
  5. 30 5月, 2009 4 次提交
    • N
      [ARM] alternative copy_to_user: more precise fallback threshold · c626e3f5
      由 Nicolas Pitre 提交于 
      Previous size thresholds were guessed from various user space benchmarks
using a kernel with and without the alternative uaccess option.  This
is however not as precise as a kernel based test to measure the real
speed of each method.

This adds a simple test bench to show the time needed for each method.
With this, the optimal size treshold for the alternative implementation
can be determined with more confidence.  It appears that the optimal
threshold for both copy_to_user and clear_user is around 64 bytes. This
is not a surprise knowing that the memcpy and memset implementations
need at least 64 bytes to achieve maximum throughput.

One might suggest that such test be used to determine the optimal
threshold at run time instead, but results are near enough to 64 on
tested targets concerned by this alternative copy_to_user implementation,
so adding some overhead associated with a variable threshold is probably
not worth it for now.
Signed-off-by: NNicolas Pitre <nico@marvell.com>
      c626e3f5
    • N
      [ARM] lower overhead with alternative copy_to_user for small copies · cb9dc92c
      由 Nicolas Pitre 提交于 
      Because the alternate copy_to_user implementation has a higher setup cost
than the standard implementation, the size of the memory area to copy
is tested and the standard implementation invoked instead when that size
is too small.  Still, that test is made after the processor has preserved
a bunch of registers on the stack which have to be reloaded right away
needlessly in that case, causing a measurable performance regression
compared to plain usage of the standard implementation only.

To make the size test overhead negligible, let's factorize it out of
the alternate copy_to_user function where it is clear to the compiler
that no stack frame is needed.  Thanks to CONFIG_ARM_UNWIND allowing
for frame pointers to be disabled and tail call optimization to kick in,
the overhead in the small copy case becomes only 3 assembly instructions.

A similar trick is applied to clear_user as well.
Signed-off-by: NNicolas Pitre <nico@marvell.com>
      cb9dc92c
    • L
      [ARM] alternative copy_to_user/clear_user implementation · 39ec58f3
      由 Lennert Buytenhek 提交于 
      This implements {copy_to,clear}_user() by faulting in the userland
pages and then using the regular kernel mem{cpy,set}() to copy the
data (while holding the page table lock).  This is a win if the regular
mem{cpy,set}() implementations are faster than the user copy functions,
which is the case e.g. on Feroceon, where 8-word STMs (which memcpy()
uses under the right conditions) give significantly higher memory write
throughput than a sequence of individual 32bit stores.

Here are numbers for page sized buffers on some Feroceon cores:

 - copy_to_user on Orion5x goes from 51 MB/s to 83 MB/s
 - clear_user on Orion5x goes from 89MB/s to 314MB/s
 - copy_to_user on Kirkwood goes from 240 MB/s to 356 MB/s
 - clear_user on Kirkwood goes from 367 MB/s to 1108 MB/s
 - copy_to_user on Disco-Duo goes from 248 MB/s to 398 MB/s
 - clear_user on Disco-Duo goes from 328 MB/s to 1741 MB/s

Because the setup cost is non negligible, this is worthwhile only if
the amount of data to copy is large enough.  The operation falls back
to the standard implementation when the amount of data is below a certain
threshold. This threshold was determined empirically, however some targets
could benefit from a lower runtime determined value for optimal results
eventually.

In the copy_from_user() case, this technique does not provide any
worthwhile performance gain due to the fact that any kind of read access
allocates the cache and subsequent 32bit loads are just as fast as the
equivalent 8-word LDM.
Signed-off-by: NLennert Buytenhek <buytenh@marvell.com>
Signed-off-by: NNicolas Pitre <nico@marvell.com>
Tested-by: NMartin Michlmayr <tbm@cyrius.com>
      39ec58f3
    • N
      [ARM] allow for alternative __copy_to_user/__clear_user implementations · a1f98849
      由 Nicolas Pitre 提交于 
      This allows for optional alternative implementations of __copy_to_user
and __clear_user, with a possible runtime fallback to the standard
version when the alternative provides no gain over that standard
version. This is done by making the standard __copy_to_user into a weak
alias for the symbol __copy_to_user_std.  Same thing for __clear_user.

Those two functions are particularly good candidates to have alternative
implementations for, since they rely on the STRT instruction which has
lower performances than STM instructions on some CPU cores such as
the ARM1176 and Marvell Feroceon.
Signed-off-by: NNicolas Pitre <nico@marvell.com>
      a1f98849
  7. 29 5月, 2009 1 次提交
  9. 27 11月, 2008 2 次提交
  11. 01 9月, 2008 3 次提交
  13. 29 8月, 2008 1 次提交
  15. 07 8月, 2008 2 次提交
  17. 03 8月, 2008 1 次提交
  19. 23 6月, 2008 3 次提交
  21. 21 5月, 2007 1 次提交
  23. 22 4月, 2007 2 次提交
  25. 01 7月, 2006 1 次提交
  27. 29 6月, 2006 3 次提交
  29. 25 6月, 2006 3 次提交
  31. 16 5月, 2006 1 次提交
  33. 29 3月, 2006 1 次提交
  35. 27 3月, 2006 1 次提交
  37. 26 3月, 2006 1 次提交
  39. 22 3月, 2006 2 次提交
  41. 09 3月, 2006 1 次提交
  43. 15 1月, 2006 2 次提交
  45. 13 1月, 2006 1 次提交