Skip to content

Releases: LukasHedegaard/continual-inference

Fix multi-layer creation for transformer

Choose a tag to compare

@LukasHedegaard LukasHedegaard released this 15 Mar 11:33
37dac98

Fixed

  • Multilayer transformers when num_layers>=3.

Added

  • Tests up to python 3.12.

Fix state_buffer device after clean_state

Choose a tag to compare

@LukasHedegaard LukasHedegaard released this 16 Jun 09:25
7d7f495

Fixed

  • Ensure state_buffer remains on the same device after clean_state.

Fix string argument in TransformerEncoderLayerFactory activation

Choose a tag to compare

@LukasHedegaard LukasHedegaard released this 24 May 13:47
87cd5c2

Fixed

  • Option to use strings to specify transformer activation.

Torch 2.0 compatibility

Choose a tag to compare

@LukasHedegaard LukasHedegaard released this 24 Mar 08:52
13b1e7d

Added

  • Onnx as dev requirement.

Changed

  • Allow torch>=2.0.

Skip module and leading residual

Choose a tag to compare

@LukasHedegaard LukasHedegaard released this 16 Mar 18:36
95e65df

Added

  • Skip module.
  • "leading" mode in Residual.

Doc fixed and compatibility updates

Choose a tag to compare

@LukasHedegaard LukasHedegaard released this 15 Mar 12:02
0e7209a

### Added

  • Description of state handling to README.

Fixed

  • Documentation formatting for co.Identity() examples.
  • Horovod check for newer pytorch lightning versions.

Enhanced SingleOutputTransformerEncoderLayer and Residual fix

Choose a tag to compare

@LukasHedegaard LukasHedegaard released this 13 Jan 15:26
88fec55

### Added

  • query_index argument to SingleOutputTransformerEncoderLayer.

Fixed

  • Residual centred residual and Delay auto_delay forward_step.

Extended normalization support

Choose a tag to compare

@LukasHedegaard LukasHedegaard released this 10 Jan 10:11
8e71ffe

### Added

  • Support for GroupNorm and InstanceNorm

Major documentation overhaul

Choose a tag to compare

@LukasHedegaard LukasHedegaard released this 19 Dec 15:20
acd7d86

### Added

  • append function to co.Sequential.
  • Production-ready docstrings for public functions.
  • reduce_max to Reduce.

### Changed

  • Rename Unity to Identity to follow torch.nn.
  • Major overhaul of README, improving descriptions and adding benchmark.
  • Major overhaul of docs, improving descriptions and adding benchmark.
  • MHA warnings to only log once.

Removed

  • Unused parameters batch_first and bidirectional for RNN, GRU, and LSTM.

Fix Conditional onnx for single-option config

Choose a tag to compare

@LukasHedegaard LukasHedegaard released this 07 Dec 14:17
75e9418

Fixed

  • co.Conditional onnx support for single-option config.