Ahmed Elghandour - Academia.edu (original) (raw)
Uploads
Papers by Ahmed Elghandour
Journal of Telecommunications and Information Technology, Apr 5, 2024
In this paper, a tight lower bound for the differential entropy of the Gaussian mixture model is ... more In this paper, a tight lower bound for the differential entropy of the Gaussian mixture model is presented. First, the probability model of mixed Gaussian distribution that is created by mixing both discrete and continuous random variables is investigated in order to represent symmetric bimodal Gaussian distribution using the hyperbolic cosine function, on which a tighter upper bound is set. Then, this tight upper bound is used to derive a tight lower bound for the differential entropy of the Gaussian mixture model introduced. The proposed lower bound allows to maintain its tightness over the entire range of the model's parameters and shows more tightness when compared with other bounds that lose their tightness over certain parameter ranges. The presented results are then extended to introduce a more general tight lower bound for asymmetric bimodal Gaussian distribution, in which the two modes have a symmetric mean but differ in terms of their weights.
The International Conference on Electrical Engineering, 2018
EUROCON 2007 - The International Conference on "Computer as a Tool", 2007
Journal of Telecommunications and Information Technology, Apr 5, 2024
In this paper, a tight lower bound for the differential entropy of the Gaussian mixture model is ... more In this paper, a tight lower bound for the differential entropy of the Gaussian mixture model is presented. First, the probability model of mixed Gaussian distribution that is created by mixing both discrete and continuous random variables is investigated in order to represent symmetric bimodal Gaussian distribution using the hyperbolic cosine function, on which a tighter upper bound is set. Then, this tight upper bound is used to derive a tight lower bound for the differential entropy of the Gaussian mixture model introduced. The proposed lower bound allows to maintain its tightness over the entire range of the model's parameters and shows more tightness when compared with other bounds that lose their tightness over certain parameter ranges. The presented results are then extended to introduce a more general tight lower bound for asymmetric bimodal Gaussian distribution, in which the two modes have a symmetric mean but differ in terms of their weights.
The International Conference on Electrical Engineering, 2018
EUROCON 2007 - The International Conference on "Computer as a Tool", 2007