Coreax (v0.1.0)

Coreax is a library for coreset algorithms, written in JAX for fast execution and GPU support.

Setup

Before installing Coreax, make sure JAX is installed. Be sure to install the preferred version of JAX for your system.

1. Install JAX noting that there are (currently) different setup paths for CPU and GPU use.

2. Install Coreax:

$ python3 -m pip install coreax

3. Optionally, install additional dependencies required to run the examples:

$ python3 -m pip install coreax[test]

Contents

• About Coresets
  • Quick Example
  • Example applications
• Quickstart
  • Kernel herding
  • Kernel herding with weighting
  • Kernel herding with refine
  • Scalable herding
  • Stein kernel herding
  • Score matching example
• Frequently Asked Questions

API Reference

• Approximations
  • KernelMeanApproximator
  • RandomApproximator
  • ANNchorApproximator
  • NystromApproximator
  • _anchor_body()
• Core Subsets
  • KernelHerding
  • RandomSample
• Data
  • DataReader
  • ArrayData
• Kernels
  • median_heuristic()
  • Kernel
  • SquaredExponentialKernel
  • LaplacianKernel
  • PCIMQKernel
  • SteinKernel
  • _current_class
• Metrics
  • Metric
  • MMD
• Networks
  • ScoreNetwork
  • create_train_state()
• Reduction
  • Coreset
  • ReductionStrategy
  • SizeReduce
  • MapReduce
• Refine
  • Refine
  • RefineRegular
  • RefineRandom
  • RefineReverse
  • _current_class
• Score Matching
  • ScoreMatching
  • SlicedScoreMatching
  • KernelDensityMatching
  • _current_class
• Utility Functions
  • KernelComputeType
  • NotCalculatedError
  • apply_negative_precision_threshold()
  • squared_distance()
  • squared_distance_pairwise()
  • difference()
  • pairwise_difference()
  • solve_qp()
  • jit_test()
  • SilentTQDM
• Weights
  • WeightsOptimiser
  • SBQ
  • MMD

Bibliography

[liu2016kernelized]

Qiang Liu, Jason D. Lee, and Michael I. Jordan. A kernelized stein discrepancy for goodness-of-fit tests and model evaluation. 2016. arXiv:1602.03253.

[ssm]

Yang Song, Sahaj Garg, Jiaxin Shi, and Stefano Ermon. Sliced score matching: a scalable approach to density and score estimation. In Uncertainty in Artificial Intelligence, 574–584. PMLR, 2020.

[chatalic2022nystrom]

Antoine Chatalic, Nicolas Schreuder, Alessandro Rudi, and Lorenzo Rosasco. Nyström Kernel Mean Embeddings. 2022. arXiv:2201.13055.

[garreau2018median]

Damien Garreau, Wittawat Jitkrittum, and Motonobu Kanagawa. Large sample analysis of the median heuristic. 2018. arXiv:1707.07269.

[improved_sgm]

Yang Song and Stefano Ermon. Improved techniques for training score-based generative models. In Advances in Neural Information Processing Systems, volume 33, 12438–12448. 2020.

[huszar2016optimally]

Ferenc Huszar and David Duvenaud. Optimally-Weighted Herding is Bayesian Quadrature. 2016. arXiv:1408.2049.

Release Cycle

We anticipate two release types: feature releases and security releases. Security releases will be issued as needed in accordance with the security policy. Feature releases will be issued as appropriate, dependent on the feature pipeline and development priorities.

Coming Soon

Some features coming soon include:

• Coordinate bootstrapping for high-dimensional data.

• Other coreset-style algorithms, including kernel thinning and recombination, as means to reducing a large dataset whilst maintaining properties of the underlying distribution.

Indices and Tables

• Index

• Module Index