Menu Home

abs and relu are not Mercer Kernels

I am sharing some rough notes (in R and Python) here on how while dot(a, b) fulfills “Mercer’s condition” (by definition!, and I’ll just informally call these beasts a “Mercer Kernel”), the seemingly harmless variations abs(dot(a, b)) relu(dot(a, b)) are not Mercer Kernels (relu(x) = max(0, x) = (abs(x) + […]

Measure Theoretic Probability Video

I’d like to share a brief orientation video on measure theory based probability. Measure theory is a rigorous axiomatic treatment of probability that defers on interpretation (such as frequentist interpretation, Bayesian interpretation, or even Kolmogorov/Chaitin complexity). (link)