Leaky Relu, Elu, Relu, Relu1, Relu0To1, Relu6, Tanh, Sigmoid, and HardSwish

PiperOrigin-RevId: 564537536

PiperOrigin-RevId: 564529533

PiperOrigin-RevId: 564528951

Needed for sharding int4 models.

PiperOrigin-RevId: 564528408

PiperOrigin-RevId: 564526562

PiperOrigin-RevId: 564526383

PiperOrigin-RevId: 564518057

PiperOrigin-RevId: 564516421

Rearrange the code that unroll the last while-loop iteration to avoid cloning
the instruction being pipelined, which is unused in the iteration. This is to
prepare for the next change to support backward pipelining recv-done without
generating the unused recv and recv-done pair.

PiperOrigin-RevId: 564515742

1. Adding bidirectional propagation paths among nodes within the same shard_group
2. Enforce the shardings from the same shard_as group to take the same sharding in the end.

PiperOrigin-RevId: 564504486

PiperOrigin-RevId: 564500466

PiperOrigin-RevId: 564494782

According to
https://www.tensorflow.org/api_docs/python/tf/math/unsorted_segment_sum:

> If the given segment ID i is negative, the value is dropped and will not be
> added to the sum of the segment.

PiperOrigin-RevId: 564485570

PiperOrigin-RevId: 564472190

Leaky Relu, Elu, Relu, Relu1, Relu0To1, Relu6, Tanh, Sigmoid, and HardSwish

PiperOrigin-RevId: 564472058

[SPMD] Create a placeholder sharding of type UNKNOWN with the lowest precedence that can be overwriten by any other shardings. (2/N)

UNKNOWN type is not supported in subgroup sharding.

PiperOrigin-RevId: 564456004

This way libtpu can use symbols from it.

PiperOrigin-RevId: 564454296

PiperOrigin-RevId: 564441419

Also
- Unify naming to ${scope}_${thing}_dim_idx.
- Make logic for split_lhs_nc a bit easier to follow (at least in my opinion), by
  decoupling it from the batch_size computation.

PiperOrigin-RevId: 564435916

PiperOrigin-RevId: 564434713

PiperOrigin-RevId: 564428072

[XLA] Use max size of buffer in heap simulator and buffer assignment and make size DCHECKs into CHECKs

PiperOrigin-RevId: 564421004

PiperOrigin-RevId: 564420754

PiperOrigin-RevId: 564415721

Sometimes, there's an exorbitant number of edges between two same notes A and B
(e.g. passing parameters through). After ~64 it becomes unreadable, so better
to skip others.

PiperOrigin-RevId: 564379502

different flag default.

PiperOrigin-RevId: 564374361

Updates LLVM usage to match
[e592c2dcf5b7](https://github.com/llvm/llvm-project/commit/e592c2dcf5b7)

PiperOrigin-RevId: 564346651

[Rolling forward]

PiperOrigin-RevId: 564345870

This makes it harder to accidentally use -1.

PiperOrigin-RevId: 564334287

This reduces massively the memory allocated by XNNPACK for highly partitioned subgraphs

PiperOrigin-RevId: 564313169

PiperOrigin-RevId: 564309076

PiperOrigin-RevId: 564309075

When we use LOG(INFO), the messages appear on screen in the OSS build - this is usually not what we want.

PiperOrigin-RevId: 564305557

The change has been made in Bazel in 2020, so it should be safe to rename in TF as well.

PiperOrigin-RevId: 564301792

Extend conversion function from GoogleEdgeTpuSettings in protobuf format to GoogleEdgeTpuSettings in flatbuffer format.

PiperOrigin-RevId: 564301432

- Remove Experimental in the message name
- Add NO_QUANTIZE quantization scheme
- Change freeze_all_variables to bool type
- Allow users to specify both op type and node name in the quantization unit

PiperOrigin-RevId: 564231195

Explicit forbid dynamic shape aliasing due to potential runtime-compiler dynamic shape size calculation mismatching

PiperOrigin-RevId: 564183652

PiperOrigin-RevId: 564133181

PiperOrigin-RevId: 564133178

These are the minimal support ops required for initializing and running tests.

PiperOrigin-RevId: 564096777