Add a counter to the pasid_state so that we do not restore
the original page-table before all invalidate_range_start
to invalidate_range_end sections have finished.
Signed-off-by: NJoerg Roedel <jroedel@suse.de>

This list was only used for the task_exit notifier function.
Now that it is gone we can remove it.
Signed-off-by: NJoerg Roedel <jroedel@suse.de>
Tested-by: NJay Cornwall <Jay.Cornwall@amd.com>

Since mmu_notifier call-backs can sleep (because they use
SRCU now) we can use them to tear down PASID mappings. This
allows us to finally remove the hack to use the task_exit
notifier from oprofile to get notified when a process dies.
Signed-off-by: NJoerg Roedel <jroedel@suse.de>
Tested-by: NJay Cornwall <Jay.Cornwall@amd.com>

The state_table consumes 512kb of memory and is only sparsly
populated. Convert it into a list to save memory. There
should be no measurable performance impact.
Signed-off-by: NJoerg Roedel <jroedel@suse.de>
Tested-by: NJay Cornwall <Jay.Cornwall@amd.com>

This is a preparation for converting the state_table into a
state_list.
Signed-off-by: NJoerg Roedel <jroedel@suse.de>
Tested-by: NJay Cornwall <Jay.Cornwall@amd.com>

get_user_pages requires caller to hold a read lock on mmap_sem.
Signed-off-by: NJay Cornwall <jay.cornwall@amd.com>
Signed-off-by: NSuravee Suthikulpanit <suravee.suthikulpanit@amd.com>
Signed-off-by: NJoerg Roedel <joro@8bytes.org>

Correct spelling typo in debug messages and comments
in drivers/iommu.
Signed-off-by: NMasanari Iida <standby24x7@gmail.com>
Signed-off-by: NJiri Kosina <jkosina@suse.cz>

Add missing spin_lock initialization in
amd_iommu_bind_pasid() function and make lockdep happy
again.

Cc: stable@vger.kernel.org # >= v3.3
Signed-off-by: NJoerg Roedel <joerg.roedel@amd.com>

A few sparse warnings fire in drivers/iommu/amd_iommu_init.c.
Fix most of them with this patch. Also fix the sparse
warnings in drivers/iommu/irq_remapping.c while at it.
Signed-off-by: NJoerg Roedel <joerg.roedel@amd.com>

Add a check to the init-path of the AMD IOMMUv2 driver if
the hardware is available in the system. Only allocate all
the resources if it is really available.
Signed-off-by: NJoerg Roedel <joerg.roedel@amd.com>

This call-back is invoked when the task that is bound to a
pasid is about to exit. The driver can use it to shutdown
all context related to that context in a safe way.
Signed-off-by: NJoerg Roedel <joerg.roedel@amd.com>

This callback can be used to change the PRI response code
sent to a device when a PPR fault fails.
Signed-off-by: NJoerg Roedel <joerg.roedel@amd.com>

Since pages are not pinned anymore we need notifications
when the VMM changes the page-tables. Use mmu_notifiers for
that.
Also use the task_exit notifier from the profiling subsystem
to shutdown all contexts related to this task.
Signed-off-by: NJoerg Roedel <joerg.roedel@amd.com>

Register the notifier for PPR faults and handle them as
necessary.
Signed-off-by: NJoerg Roedel <joerg.roedel@amd.com>

This patch adds routines to bind a specific process
address-space to a given PASID.
Signed-off-by: NJoerg Roedel <joerg.roedel@amd.com>

This patch adds the amd_iommu_init_device() and
amd_iommu_free_device() functions which make a device and
the IOMMU ready for IOMMUv2 usage.
Signed-off-by: NJoerg Roedel <joerg.roedel@amd.com>

Add a Kconfig option for the optional driver. Since it is
optional it can be compiled as a module and will only be
loaded when required by another driver.
Signed-off-by: NJoerg Roedel <joerg.roedel@amd.com>