Skip to content
Steven Purcell

Category

Data Science

3 posts

All categoriesRSS for this category

4 min read

Data Science · Development

Fine Tuning Justice: The Role of Pre-Trained LLMs in Enhancing Federal Investigations and Legal Procedures

Large language models (LLMs) represent the next generation of artificial intelligence applications, attaining widespread attention and adoption. These models demand substantial energy and resources for training. Consequently, there has been a shift towards developing pre-trained models like bidirectional encoder representations from transformers (BERT), utilizing millions of parameters from training texts to create general use models. An evolution of this approach involves fine-tuning models with domain-specific data, enhancing their utility in fields such as medicine, law, and science.

3 min read

Data Science

Optimizing Gradient Boosting Models

Gradient boosting classifier models are a powerful type of machine learning algorithm that outperform many other types of classifiers. In simplest terms, gradient boosting algorithms learn from the mistakes they make by optmizing on gradient descent. A gradient boosting model values the gradient descent, or the direction of the steepest increase of a function, to make adjustments so that the function can increase rapidly over each iteration. Gradient boosting models can be used for classfication or regression. This post will concern itself with gradient boosting classification. In particular, we will study and optimize three gradient boosting models, AdaBoost (sklearn), XGBoost, and Gradient Boosting Classifier (sklearn). We will study these classifiers with the Kaggle data set, Kaggle: Diabetes Health Indicators Dataset . In particular, we will use the binary data set. I will not be doing any cleansing or engineering of the data. I am strictly experimenting with the effects of the learning rate and number of estimators hyperparameters on gradient boosting model performance.

5 min read

Data Science

Traditional Methods vs AI Methods in Forecasting

Forecasting remains an indispensable tool for businesses to make informed decisions about future trends, demands, and opportunities. Accurate forecasts can lead to better resource allocation, inventory management, and strategic planning. When it comes to forecasting, data scientists have many tools at their disposal, ranging from traditional and time-tested methods to advanced artificial intelligence (AI) techniques. While AI methods have gained significant attention in recent years, traditional forecasting methods like Moving Average, Exponential Moving Average, and Linear Regression Forecasting still hold their ground in many real-world scenarios. As a data scientist with substantial experience in machine learning and big data analytics, I will shed light on why, in most cases, traditional forecasting methods remain preferable to their more advanced counterparts.