Published inAI MindUnderstanding ADOPT: A New Optimizer Beyond AdamOptimization is at the heart of deep learning. When training neural networks, we aim to minimize a loss function that measures how well our…Nov 11, 20241Nov 11, 20241
Published inAI MindContinual Learning in Stock Price Prediction: Elastic Weight ConsolidationDeep learning models have revolutionized many fields, including financial market prediction. However, these models face a significant…Nov 5, 20241Nov 5, 20241
Published inAI MindTemporal Convolutional Networks (TCN) and Dilated TCN for Time Series ForecastingTime series forecasting is a critical component in many domains, from stock market prediction to weather forecasting. While traditional…Nov 3, 2024Nov 3, 2024
Published inAI MindStock Price Forecasting Using Pretrained Language Models: A look into TimeMoEIntroduction Time series forecasting is a crucial component in financial analysis, particularly in stock price prediction. Traditional…Oct 30, 20241Oct 30, 20241
Published inAI MindUniversal Assisted Generation: Supercharging Language Model Decoding with Speculative DecodingIn a previous blog I discussed on Speculative Decoding https://medium.com/ai-mind-labs/speculative-decoding-in-llms-76d66a879a3d . Today…Oct 30, 2024Oct 30, 2024
Published inAI MindLyapunov Exponent: A Tool for Convergence and Training Dynamics in Neural NetworksIn complex systems like neural networks, understanding how small changes in initial conditions affect the behavior of the system can be…Oct 28, 2024Oct 28, 2024
Published inAI MindUnderstanding Logit Lens: Peering into Language Model LayersIntroductionOct 26, 2024Oct 26, 2024
Published inAI MindSpeculative Decoding in LLMsBefore diving into speculative decoding, it's important to understand the concept of decoding in NLP. Decoding refers to the process by…Oct 24, 2024Oct 24, 2024
Published inAI MindUnderstanding Embeddings and the Privacy Risk of Inverting Them: Vec2Text ExplainedIntroductionOct 24, 2024Oct 24, 2024
Published inAI MindUnderstanding Consistency Models with codeWhat Are Consistency Models?Oct 24, 2024Oct 24, 2024
