<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Alberto Paderno on Medium]]></title>
        <description><![CDATA[Stories by Alberto Paderno on Medium]]></description>
        <link>https://medium.com/@albpaderno?source=rss-132e4e52c0a------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*CY5W-65_wls0DQnMwW3QFw.jpeg</url>
            <title>Stories by Alberto Paderno on Medium</title>
            <link>https://medium.com/@albpaderno?source=rss-132e4e52c0a------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Sun, 31 May 2026 20:42:00 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@albpaderno/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com" rel="hub"/>
        <item>
            <title><![CDATA[My Experience with the Apple Vision Pro and Future Perspectives in Computer Vision and Healthcare]]></title>
            <link>https://pub.towardsai.net/my-experience-with-the-apple-vision-pro-and-future-perspectives-in-computer-vision-and-healthcare-36366f1f96fa?source=rss-132e4e52c0a------2</link>
            <guid isPermaLink="false">https://medium.com/p/36366f1f96fa</guid>
            <category><![CDATA[surgery]]></category>
            <category><![CDATA[healthcare]]></category>
            <category><![CDATA[technology]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[computer-vision]]></category>
            <dc:creator><![CDATA[Alberto Paderno]]></dc:creator>
            <pubDate>Mon, 05 Feb 2024 16:01:45 GMT</pubDate>
            <atom:updated>2024-02-05T16:01:45.547Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*l5fp4Pw1ZHMNQlxuWwqhow.png" /><figcaption>Just me and the Apple Vision Pro</figcaption></figure><p><em>“It was a rainy day in Palo Alto. The line in front of the Apple Store was interminable, and only a few strong-willed people could be persistent enough to wait for hours and have a shot at earning one of the first commercially available Apple Vision Pro. Each step brought me closer to a revolution in computing…”</em></p><p>Ok, let’s be real. This sounds great as an opening, but I would never wait in line for any commercial product. However, thanks to the amazing Digital Health team of the <strong>Stanford Byers Center for Biodesign</strong>, I was able to try the new Apple Vision Pro and have some discussion about its potential in computer vision and healthcare.</p><p><a href="https://biodesign.stanford.edu/programs/stanford-courses/biodesign-for-digital-health.html">Biodesign for Digital Health</a></p><h3>Why Computer Vision and Healthcare</h3><p>I won’t talk about the manufacturing quality. Apple usually does an excellent job and their new top-of-the-line product does not underdeliver. There are already a lot of professional reviews talking about this, not really my field. Let’s look at things from a computer vision and AI perspective — what is the potential, what should we expect, and what are the future lines of research? <br>And, of course, being a surgeon, it’s difficult not to think about the subsequent developments of this type of technology in healthcare. My head bumped into enough screens in the operating room to realize that they might not be the best solution for our current applications. Screens are everywhere in healthcare: endoscopic, laparoscopic, exoscopic, robotic surgery, patient monitoring (ECG, saturation, ventilation), radiology, etc. And if you think the Apple Vision Pro is expensive, you should look at the prices of medical-grade monitors. <br>But screens were a necessary evil that allowed us to shift from purely optical visualization technologies (e.g., optical microscopes and loupes) to a direct digital input — the dream of every computer vision researcher. With this type of input, it’s possible to collect training data (data that we previously threw away!), analyze procedures, and develop AI applications that are valuable in clinical practice.</p><h3>From Eyes to Algorithms</h3><p>While my initial focus was testing visual quality, I was struck by how intuitive the experience was, and I found myself being more impressed by some less-discussed features:</p><p>- Eye-tracking</p><p>- Passthrough quality</p><p>- Hand/pinch detection and tracking</p><p>These are the elements that make the experience particularly seamless and that, together with the concept of “Spatial Computing,” will revolutionize current UI/UX design standards. But they also made me more aware of the possible interactions with computer vision and AI.</p><p>Let me explain.</p><h4>Eye-tracking is not just the “new mouse”; it’s a data source</h4><p><strong>Attention</strong> is a central concept in AI and computer vision. The article “<a href="https://arxiv.org/abs/1706.03762">Attention is All You Need</a>” introduced this concept by describing the transformer architecture in natural language processing, and “<a href="https://arxiv.org/abs/2010.11929">An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale</a>” transferred this concept to the visual field. We are talking about a mathematical form of attention, but the broad meaning is still there.</p><p>Eye movements are the external manifestation of human visual attention. For the first time, we (well, Apple) will have an instrument that tracks and records eye movements prospectively, long term. This is an exciting concept since eye micromovements are mostly involuntary and will help us understand how we perceive the visual world — with potential correlates on the way we structure and evaluate computer vision algorithms. On the other hand, it’s scary to consider that, by virtue of their subconscious nature, eye movements might help profile customers or track what the person is thinking — a sort of “you are what you look at” concept.</p><p>Finally, medical conditions (especially neurologic and balance disorders) can influence eye micromovements and eye-hand coordination. Constant tracking may be a beneficial “opportunistic screening” tool to diagnose these conditions early.</p><h4>High passthrough quality brings computer vision to vision</h4><p>One of the most striking elements is the impact of high passthrough quality on the overall experience. The objective is to shut off the perception of looking at a screen and to integrate digital elements into the real world. And the Apple Vision Pro gets really close to that.</p><p>This has been achieved thanks to the concomitant increase in resolution and quality of camera sensors and micro-OLED displays — and we are getting closer to a condition where it will be impossible to determine if we are looking through a digital camera + screen, or through a glass.</p><p>As a consequence, it will be possible to apply computer vision to every setting in everyday life. It’s not just autonomous driving and specific applications. Computer vision applications won’t need a separate device — smartphones, tablets, computers, endoscopes — the interaction will be direct.</p><blockquote><strong>Spatial computing is the perfect platform for computer vision.</strong></blockquote><h4>Interfaces based on hand-eye input will change UI/UX design principles</h4><p>Conventional interfaces are based on well-defined input devices (e.g., mouse, keyboard, trackpad). Here, everything in the visual field can potentially become an input source — starting from the hands and extending to the entire available space. Again, this is based on computer vision (eye and hand/gesture tracking on top of everything) — the entire video feed from the numerous cameras must be processed as an “input”, reprocessed, and integrated with digital components (creating the “output”), shattering the conventional separation between input and output. This will significantly increase the interactions between the applications, user, and environment — ultimately requiring new UI/UX design paradigms.</p><h3>Yes, And What About Healthcare?</h3><p>As a physician and surgeon, it’s difficult not to think about the potential revolution this technology would bring into healthcare, apart from the previously mentioned struggle between my head and floating monitors. The surgeon could easily position and look at 2D or 3D screens during endoscopic or exoscopic surgery, integrating the view with the patient’s information from vital signs tracking, radiologic imaging, and image enhancement techniques. The view could be further extended with dedicated computer vision algorithms to detect instruments, tissues, and anatomical structures.</p><p>Finally, UI/UX design in healthcare is far from ideal. Ease of use and functional layouts are often low priorities when dealing with complex medical data. However, the advent of spatial computing offers a blank slate to build on, maybe following better concepts of design and usability.</p><p>The <strong>Spezi</strong> framework from Stanford caters to these needs thanks to its modular structure. Specifically, Spezi is an open-source framework for the rapid development of modern, interoperable digital health applications, and the team is already working on integrating applications in VisionOS.</p><p><a href="https://spezi.sites.stanford.edu/">Spezi</a></p><p>In wrapping up my dive into the Apple Vision Pro and its intersection with computer vision and healthcare, it’s clear we’re on the cusp of a transformative period. This device isn’t just about sharper images or smoother interfaces; it’s about redefining our interaction with technology and its application in medicine. The Vision Pro exemplifies how technology can seamlessly integrate into our lives, offering insights that extend far beyond the screen.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=36366f1f96fa" width="1" height="1" alt=""><hr><p><a href="https://pub.towardsai.net/my-experience-with-the-apple-vision-pro-and-future-perspectives-in-computer-vision-and-healthcare-36366f1f96fa">My Experience with the Apple Vision Pro and Future Perspectives in Computer Vision and Healthcare</a> was originally published in <a href="https://pub.towardsai.net">Towards AI</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[How To Use AI To Improve the Literature Review Process]]></title>
            <link>https://pub.towardsai.net/how-to-use-ai-to-improve-the-literature-review-process-e370e3d496d4?source=rss-132e4e52c0a------2</link>
            <guid isPermaLink="false">https://medium.com/p/e370e3d496d4</guid>
            <category><![CDATA[large-language-models]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[science]]></category>
            <category><![CDATA[healthcare]]></category>
            <category><![CDATA[research]]></category>
            <dc:creator><![CDATA[Alberto Paderno]]></dc:creator>
            <pubDate>Wed, 24 Jan 2024 14:01:06 GMT</pubDate>
            <atom:updated>2024-01-24T14:01:06.221Z</atom:updated>
            <content:encoded><![CDATA[<h4><em>If AI will take my job, it might as well start with literature reviews</em></h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*VeObXYY4yT2VEkeKHVyZrg.png" /></figure><h3>The current problem in scientific research</h3><p>We live in an era dominated by technology and AI, yet our access to scientific literature remains substantially unchanged in the last 50 years.</p><p>Let’s take medical literature as an example. PubMed remains the main access point for most researchers, and it functions as an old-style repository. There are no data aggregation functionalities; the search is based on basic criteria that mostly only rely on the article’s title, abstract, and keyword. There are no ways to interact with or analyze the content. No advanced data visualization.</p><p>And it isn’t PubMed’s fault. It does what it is intended to do: give access to research from a wide variety of Journals.</p><p>However, the current research process is clunky and time-consuming. As researchers and medical practitioners, when we need to get updated information on a specific topic, the process is usually the same (either with PubMed or other scientific repositories):</p><ul><li>Check for systematic reviews and meta-analyses.</li><li>Aggregate and compare the results of the different systematic reviews and meta-analyses.</li><li>Read and analyze the main articles in the reviews.</li><li>Check for cross-references.</li></ul><p>If reviews are not available:</p><ul><li>Check for recent articles on the topic.</li><li>Get an idea of the overall trend.</li><li>Compare patient numerosity in the different articles, level of evidence, and research-group experience.</li></ul><p>Formulating a quick and impartial perspective on a specific subject is often difficult. One typical issue is <strong>anchoring bias</strong>, which occurs when individuals disproportionately depend on the initial information they receive about a topic. Additionally, <strong>selection bias</strong> plays a big role when the available literature or data is chosen based on accessibility or the author’s preferences rather than a comprehensive overview of the subject. These are just a few examples of the various issues that can skew judgment in forming opinions during the research process.</p><h3>How can AI help?</h3><h4><em>Dedicated solutions</em></h4><p>Some dedicated solutions for literature search and review are currently available. This is a great sign, and we are moving in the right direction. However, their practical utility in specialistic fields is still limited. Some examples are:</p><p><strong>Connected Papers</strong> (<a href="http://www.connectedpapers.com">www.connectedpapers.com</a>), <strong>Litmaps</strong> (<a href="http://www.litmaps.com">www.litmaps.com</a>), and <strong>Research Rabbit</strong> (<a href="http://www.researchrabbit.ai">www.researchrabbit.ai</a>) visually represent the research network on a topic connecting relevant articles. The outcome is a graphical literature map that can provide an overall view of the articles around that domain. Other than visual representation, these tools are also helpful in identifying cross-references.</p><p><strong>Elicit</strong> (<a href="http://www.elicit.org">www.elicit.org</a>) aims to use AI to answer research questions by summarizing the available literature. However, the current outcome is still far from a comprehensive analysis of all the articles. It can be useful for quick data extraction, but it sometimes misses key publications, and it’s not possible to manually upload a series of papers we are interested in. It’s an intriguing approach, but to date, its ideal target is the non-expert who wants to get scientifically-proven generic insights on a new topic.</p><p>Finally, <strong>Scite</strong> (<a href="http://www.scite.ai">www.scite.ai</a>) allows users to see how a scientific paper has been cited by providing the context of the citation and classifying it as supporting, mentioning, or disputing the cited claim. This is an excellent addition to the toolbox, but the aim is to assist the experienced researcher in the conventional review process rather than creating an entirely new path.</p><h4>Generalized approaches</h4><p>Other than dedicated solutions, conventional LLM-based AI tools can also be beneficial.<br>Difficult not to mention <strong>ChatGPT</strong> — difficult not to mention it anywhere in the AI field, to be honest. However, its use cases are limited to generic topics and superficial knowledge that do not require high-level expertise. The web search tool can help in getting up-to-date knowledge, but the search is not limited to the academic literature and is frequently too generic. Hallucinations are also a significant problem; they can be pop up in the main text (quite rarely) or in citations (pretty frequently).<br>Well, let’s avoid making this error:</p><p><a href="https://fortune.com/2023/06/23/lawyers-fined-filing-chatgpt-hallucinations-in-court/">Humiliated lawyers fined $5,000 for submitting ChatGPT hallucinations in court: &#39;I heard about this new site, which I falsely assumed was, like, a super search engine&#39;</a></p><p><strong>Perplexity.ai </strong>(www.perplexity.ai) is another interesting option. It is possible to limit the search to the academic domain, and I’ve found that in terms of information retrieval and summarization, it provides better results than ChatGPT — at least in the medical field. Nevertheless, it’s far from summarizing specialized topics comprehensively since it tends to focus on the first search results.</p><h3>A personalized pipeline for using LLMs in literature reviews</h3><p>A potential option is to develop simple research pipelines based on basic Python code and LLM APIs to extract and summarize the needed data. There are different approaches, and this is a quick practical example.</p><h4>Step 1 — Preliminary screening</h4><p>In highly specialistic topics, we want to be sure that the articles we select for the initial screening are comprehensive. Unfortunately — for now — this is still a manual step (at least in my hands). However, there are some tricks. For example, ChatGPT helps convert a narrative research question into an effective PubMed research string. This might require some iteration, but it saves a lot of time down the line. You also might want to perform different searches with distinct strings.</p><h4>Step 2 — Exporting results</h4><p>After selecting the articles, you can press “Send to” on the PubMed research page and create the file.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*HA8B1I7T6VIbDOY7BdH23A.png" /><figcaption>PubMed page</figcaption></figure><h4>Step 3 — Importing results in a citation manager</h4><p>If you do research consistently, you probably already use a citation manager. My example is with <strong>Zotero</strong> (<a href="http://www.zotero.org">www.zotero.org</a>), but it’s easily applicable to all the other apps. Here, you can merge and rearrange articles, exclude duplicates, and have an overall view of the collection.<br>With Zotero, it is possible to export a library in CSV format containing all the relevant information (including the full abstract), allowing you to subsequently manage it as a Pandas Dataframe.</p><h4>Step 4 — Processing the data</h4><p>First, let’s import the dataset:</p><pre>import pandas as pd<br>df = pd.read_csv(&#39;Review_2024.csv&#39;)<br>df.head()</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*v3MNNIMpI0i3NmXHZu1M1A.png" /><figcaption>Example of a dataset</figcaption></figure><p>In this case, the main fields I’m interested in are: ‘Title’ and ‘Abstract Note’ (column containing the full abstract). Many other fields are available for different types of analysis.</p><p>At this point, it’s possible to automatically analyze and categorize titles and abstracts using an LLM. I think that Gemini Pro is a good choice at this time. Two main reasons:</p><ul><li>The outputs are of adequate quality</li><li>The API is FREE! (For now)</li></ul><p>This is just a quick example:</p><pre>import google.generativeai as genai<br>import json<br><br>GOOGLE_API_KEY = &#39;YOUR_API_KEY&#39;<br>genai.configure(api_key=GOOGLE_API_KEY)<br><br>def query_gemini(title, abstract):<br>    model = genai.GenerativeModel(&#39;gemini-pro&#39;)<br><br>    prompt = (&quot;&quot;&quot;<br>Given the following title and abstract, output a text in JSON format specifying:<br>- &quot;endoscopy&quot; : &quot;yes&quot; or &quot;no&quot; - If related to endoscopy or not<br>- &quot;subspeciality&quot;: &quot;Laryngology&quot;, &quot;Head and Neck Surgery&quot;, &quot;Otology&quot;, etc<br>- &quot;number_of_patients_analyzed&quot;: &quot;number of patients included in the study&quot;<br>- &quot;objective&quot;:&quot;study objective here&quot;<br>- &quot;objective_short&quot;: &quot;very short summary of the study objective in max 5 words&quot;<br>- &quot;AI_technique&quot; : &quot;Resnet&quot;, &quot;Generic CNN&quot;, etc<br>- &quot;Short_summary&quot; : &quot;Short summary of the study&quot;<br><br>              &quot;&quot;&quot;<br>              &quot;\n\nTitle: {}\nAbstract: {}\n&quot;).format(title, abstract)<br><br>    response = model.generate_content(prompt)<br><br>    return response.text.strip().lstrip(&#39;``` JSON\n&#39;).rstrip(&#39;\n```&#39;)</pre><p>Here, we structure the prompt using the JSON format, and then we get it ready to be added to the dataframe. After different tries, this is the way to make the output more consistent and easier to parse.</p><pre>columns = [&#39;endoscopy&#39;, &#39;subspeciality&#39;, &#39;number_of_patients_analyzed&#39;, &#39;objective&#39;, &#39;objective_short&#39;, &#39;AI_technique&#39;, &#39;Short_summary&#39;]<br>for col in columns:<br>    df[col] = None</pre><p>Then, let’s add the required columns to the main dataframe.</p><pre>for start in range(0, len(df), 300):<br>    end = start + 300<br>    responses = []<br><br>    for index, row in df.iloc[start:end].iterrows():<br>        response = query_gemini(row[&#39;Title&#39;], row[&#39;Abstract Note&#39;])<br>        try:<br>            parsed_response = json.loads(response)<br>            for col in columns:<br>                df.loc[index, col] = parsed_response.get(col, None)<br>        except json.JSONDecodeError:<br>            print(f&quot;Failed to parse response for row {index}&quot;)<br>    chunk_df = df.iloc[start:end]<br>    chunk_df.to_excel(f&#39;/YOUR_FOLDER/dataset_chunk_{start//300 + 1}.xlsx&#39;, index=False)</pre><p>Finally, let’s start the process. I prefer to create different dataset chunks (every 300 articles, in this case) during the process. Gemini Pro is free until 60 QPM but it sometimes tends to limit access for a few minutes after a high number of requests. With this approach, you’ll be able to retain most of the work even after a crash.</p><p>After all of that, you’ll have a fully categorized literature search. It’s possible to analyze the distribution of topics (either with conventional statistical software or ChatGPT), get an overall idea of the different articles thanks to short summaries, etc. This is an interesting approach when you are thinking about writing a systematic review and meta-analysis following the current research and reporting guidelines, such as the PRISMA statement.</p><h3>Future perspectives</h3><p>The process is still time-consuming and highly manual. A potential development would be the introduction of “smart” article repositories that would automatically execute these parsing, classification, and summarization steps as an article is added. This automation would streamline the research pipeline and enhance accuracy and consistency in processing and presenting information. Let’s face it, systematic reviews and meta-analyses should not be performed by groups of researchers at a single point in time but should be interactive and updated after each article is added to the topic. This type of scientific dashboard would significantly enhance how research is accessed and distributed.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=e370e3d496d4" width="1" height="1" alt=""><hr><p><a href="https://pub.towardsai.net/how-to-use-ai-to-improve-the-literature-review-process-e370e3d496d4">How To Use AI To Improve the Literature Review Process</a> was originally published in <a href="https://pub.towardsai.net">Towards AI</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Psychopathology of Large Language Models: Foundation Models in a Neurobiological Perspective]]></title>
            <link>https://pub.towardsai.net/psychopathology-of-large-language-models-foundation-models-in-a-neurobiological-perspective-0f6f6e96a82b?source=rss-132e4e52c0a------2</link>
            <guid isPermaLink="false">https://medium.com/p/0f6f6e96a82b</guid>
            <category><![CDATA[neuroscience]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[llm]]></category>
            <category><![CDATA[ai]]></category>
            <dc:creator><![CDATA[Alberto Paderno]]></dc:creator>
            <pubDate>Thu, 11 Jan 2024 12:01:35 GMT</pubDate>
            <atom:updated>2024-01-11T12:01:35.292Z</atom:updated>
            <content:encoded><![CDATA[<h4><em>Optimal Brain Damage, Synaptic Pruning, and the Problem of “Hallucinations”</em></h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*n8oP-PVbQeVs6HOAY5voUw.png" /><figcaption>Artificial psychosurgery, modifying the architecture to improve the function — Image generated by Dall-E 3</figcaption></figure><p>The performance of large language models (LLMs) is growing at a breakneck pace. Models provide more coherent and consistent answers, with a progressive and significant reduction of hallucinations. This improvement is mainly related to the overall optimization of model architecture and training data, as well as the constant increase in parameters. Nonetheless, hallucinations are still occurring, sometimes in unexpected ways, and it is still a significant challenge to trace the source of these anomalies. Our understanding of the inner workings of LLMs is less detailed than what one could assume when looking at their widespread application, and this is a considerable limit in specific domains where random and unexpected errors could lead to severe consequences (e.g., healthcare and finance).</p><h4><strong>Neurodevelopmental Correlates in Artificial Intelligence</strong></h4><p>Understanding the neural development process in humans can be a useful guide to design and optimize LLMs. The human brain, especially during its development, undergoes various processes that enhance its efficiency and functionality, ensuring that neural circuits are adapted based on environmental interactions. During fetal development, the brain undergoes rapid growth, with an overproduction of synaptic connections. Subsequently, as the individual matures, synaptic pruning refines this neural network by removing redundant connections, thereby enhancing the groundedness and efficiency of neural processes. Neuronal activity plays a key role in this process - synapses that are frequently used and activated are strengthened and preserved, while those that are seldom used are pruned away.</p><blockquote><em>Evolution has selected for this approach in network formation: construction through overabundance and subsequent pruning.</em></blockquote><p>These neural networks are much more robust and efficient than networks that are constructed through other means (1).</p><h4><strong>Neuropathology of Biological Neural Networks</strong></h4><p>From the pathological viewpoint, alterations in synaptic pruning are one of the proposed etiological mechanisms behind neurological and psychiatric disorders (2<strong>).</strong> On one side, over-pruning can contribute to the excessive loss of functional synapses, such as in Alzheimer’s disease. On the other, unbalanced pruning is one of the potential causes of disorders such as autism and schizophrenia, where an inefficient “fine-tuning” of synaptic connections might lead to characteristic disease presentations. A dysregulated pruning process may be the source of symptoms such as hallucinations, delusions, and disorganized thinking in schizophrenia, as well as sensory processing challenges and behavioral profiles typical of autism.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*LhYr2dDzY9Wfee9ilrd54g.png" /><figcaption>Image generated by Dall-E 3</figcaption></figure><h4><strong>Neuropathology of LLMs</strong></h4><p>In LLMs, <em>‘hallucinations’</em> typically refer to the generation of nonsensical or nonfactual content that is not grounded in the source material. However, Smith et al. (3<strong>)</strong> proposed the term <em>‘confabulation’</em> as a more fitting descriptor. In contrast to hallucination, confabulation involves generating incorrect narrative details, influenced by the model’s existing knowledge and contextual understanding, rather than implying any form of sensory perception. This redefinition aligns more closely with the operation of LLMs, which synthesize outputs based on patterns learned from vast datasets rather than experiencing sensory inputs.</p><p>In general, the extensive training of LLMs mirrors the initial stages of brain development, where a vast array of neural connections are formed. However, like the human brain, LLMs may require an adjunctive refinement process. This refinement, analogous to synaptic pruning in human development, would involve cleaning and optimizing the model’s architecture. Without this process, an LLM may risk being overwhelmed by ‘white noise’ — excess information or connections that obscure or distort the intended output.</p><p>So, the continual improvement of LLMs through methods like pruning may be required to ensure that their outputs are relevant, accurate, and grounded in the source material. As discussed above, these characteristics are particularly relevant when operating in fields where the reliability of the information provided by the LLM is critical for safety reasons. In fact, Elaraby et al. (4) showed that, to date, LLM-generated summaries in the legal or health space sometimes contain inaccurate information with the potential for a real-life negative impact.</p><h4><strong>A Technical Perspective on LLM Pruning — “Optimal Brain Damage”</strong></h4><p>As already described in technical papers, LLM pruning involves the reduction of model size by eliminating weights that contribute minimally to model performance, thus generating a sparser model. This process leads to more efficient models that require less computational power and resources while maintaining or even enhancing performance.</p><p>Pruning in LLMs is strikingly similar to synaptic pruning in neurodevelopment. Just as synaptic pruning optimizes neural pathways by removing redundant connections, model pruning in LLMs aims to maintain or enhance performance by removing redundant weights​​.</p><p>A fascinating description of the potential impact of model pruning was provided as early as 1989 by LeCun et al. (5) in a paper titled “<strong>Optimal Brain Damage</strong>.” As stated by the authors, by removing unimportant weights from a network, several improvements can be expected: better generalization, fewer required training examples, and improved speed of learning and classification. However, rather than brain damage, this can be viewed as a physiological step in neural structure optimization, a tailored “<em>psychosurgical</em>” approach aimed at favoring the adequate “maturation” of the architecture.</p><p>Indeed, it is extremely interesting to notice that, as recently demonstrated by Chrysostomou et al. (6), pruned LLMs tend to hallucinate less than their full-sized counterparts, potentially due to a greater reliance on source input rather than parametric knowledge from pre-training​​.</p><h4><strong>The Bigger, the Better?</strong></h4><p>The absence of adequate pruning might be one of the components underlying the presence of hallucinations in LLMs, and improvements in this field may lead to better models without the need for a significant increase in size, challenging the “<em>the bigger, the better</em>” stereotype. However, like synaptic pruning, AI model pruning is a balancing act of removing excess while preserving essential functionalities. The convergence of these biological and computational processes shows a parallel in seeking optimized efficiency and functionality in complex systems.</p><h4>References</h4><p>1. Navlakha S, Barth AL, Bar-Joseph Z. Decreasing-Rate Pruning Optimizes the Construction of Efficient and Robust Distributed Networks. Graham LJ, ed. <em>PLoS Comput Biol</em>. 2015;11(7):e1004347. doi:10.1371/journal.pcbi.1004347</p><p>2. Xie C, Xiang S, Shen C, et al. A shared neural basis underlying psychiatric comorbidity. <em>Nat Med</em>. 2023;29(5):1232–1242. doi:10.1038/s41591–023–02317–4</p><p>3. Smith AL, Greaves F, Panch T. Hallucination or Confabulation? Neuroanatomy as Metaphor in Large Language Models. Berkovsky S, ed. <em>PLOS Digit Health</em>. 2023;2(11):e0000388. doi:10.1371/journal.pdig.0000388</p><p>4. Elaraby M, Zhong Y, Litman D. Towards Argument-Aware Abstractive Summarization of Long Legal Opinions with Summary Reranking.</p><p>5. LeCun Y, Denker JS, Solla SA. Optimal Brain Damage.</p><p>6. Chrysostomou G, Zhao Z, Williams M, Aletras N. Lighter, yet More Faithful: Investigating Hallucinations in Pruned Large Language Models for Abstractive Summarization. Published online November 15, 2023. Accessed November 27, 2023. <a href="http://arxiv.org/abs/2311.09335">http://arxiv.org/abs/2311.09335</a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=0f6f6e96a82b" width="1" height="1" alt=""><hr><p><a href="https://pub.towardsai.net/psychopathology-of-large-language-models-foundation-models-in-a-neurobiological-perspective-0f6f6e96a82b">Psychopathology of Large Language Models: Foundation Models in a Neurobiological Perspective</a> was originally published in <a href="https://pub.towardsai.net">Towards AI</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[A Surgeon’s Reflections on Artificial Intelligence]]></title>
            <link>https://medium.com/data-science/a-surgeons-reflections-on-artificial-intelligence-c070bb633e9f?source=rss-132e4e52c0a------2</link>
            <guid isPermaLink="false">https://medium.com/p/c070bb633e9f</guid>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[healthcare]]></category>
            <category><![CDATA[surgery]]></category>
            <category><![CDATA[ai]]></category>
            <category><![CDATA[medicine]]></category>
            <dc:creator><![CDATA[Alberto Paderno]]></dc:creator>
            <pubDate>Tue, 02 Jan 2024 17:51:26 GMT</pubDate>
            <atom:updated>2024-01-02T17:51:26.611Z</atom:updated>
            <content:encoded><![CDATA[<h4>A Clinical Perspective on Medical Innovation</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*qRmXh59yh-AHIdwFJrFj-w.png" /><figcaption>Image generated by Dall-E 3</figcaption></figure><p>Being an oncologic surgeon is my primary job and passion. It allows me to interact with people and immerse myself in the healthcare system, not the fancy corporate Healthcare, just everyday medicine. <br>And, as a researcher in AI, I’m noticing a growing disconnect between the actual clinical practice and the prevailing objectives of AI researchers and companies. This is, of course, just a personal opinion and not a critique of the current R&amp;D processes, but it is a reflection grounded on some experience in both fields.</p><p>The disruptive potential of AI in customer software and industry is now clear. However, we must acknowledge that AI in healthcare is an entirely different animal; the degree of complexity, regulation, and risk is significantly higher than that of most other applications. Also, publicly available datasets are orders of magnitude scarcer than in many other domains due to privacy and accessibility limits.</p><blockquote><em>So, big blockers and a higher level of complexity.</em></blockquote><p>I’m currently staying in the Silicon Valley as a surgeon with a technical background in AI, which gave me direct access to this vibrant “ecosystem.” Meetings and conferences on AI are the order of the day. However, it’s difficult not to notice some facts:</p><ul><li>Clinicians do not participate in AI events.</li><li>Clinicians do not participate even in AI for Healthcare events.</li><li>The AI healthcare research is driven by the technical side, with minimal feedback/collaboration from clinicians.</li><li>Even among clinicians, there is insufficient collaboration regarding data sharing and technical development.</li></ul><h3><strong>A Tech-guided Approach</strong></h3><p>Firstly, the enthusiasm towards new technologies pushes us to try to apply them to every problem: <em>“If the only tool you have is a hammer, you tend to see every problem as a nail,”</em> in the words of Abraham Maslow. And I absolutely understand this tendency. AI is our new Thor’s hammer; why wouldn’t we want to try it on anything even remotely appropriate?</p><p>However, this directs research and progress focused on solving “technical puzzles” without answering a fundamental question. On one side, we can find amusing representations of this concept, such as the <a href="https://people.cs.umass.edu/~brun/pubs/pubs/Kiddon11.pdf">“That’s what she said” joke identifier</a> (an amusing solution, I’m not criticizing); and, on the other, examples where the forced implementation of complex deep learning workflows is <a href="https://thedailywtf.com/articles/No%2c_We_Need_a_Neural_Network">expensive and unnecessary</a>.</p><p>Secondly, typical “top-down” strategies are based on market analysis and market-share calculation. In brief, “<em>Let’s find a big and profitable field in healthcare, and let’s jam-pack it with AI.</em>” As always, it might be a great short-term strategy, but the magic disappears after a while.</p><p>These approaches are rarely effective in healthcare. Physicians and surgeons often revert to conventional practices when the advantages of the new solution are not evident. Planck’s principle can be safely applied to medical innovation, “<em>science advances one funeral at a time</em>.” For this reason, a 5–10% increase in operational efficiency, while significant at scale, is hardly applied in the medical setting— we need a 2x-10x improvement in areas relevant to everyday clinical practice.</p><h3><strong>From “bench” to bedside</strong></h3><p>A practical approach would be to identify an actual problem, assess the efficacy of current solutions, and evaluate if AI can be employed to develop better solutions — <em>the typical Mom Test</em>.</p><p><a href="https://www.momtestbook.com/">How to talk to customers &amp; learn if your business is a good idea when everyone is lying to you.</a></p><p>Currently, most major developments in AI for Healthcare are coming from Tech research groups and Tech companies. This association explains why the focus is skewed more towards the computer science side than the healthcare component.</p><p>In order to solve this issue, the direct involvement of clinicians and surgeons will be essential.</p><p>The need is clearly there. Medicine remains a highly flawed and subjective matter; calling it an “art” is looking at the full half of the glass without acknowledging that something is missing. For example:</p><ul><li>The surgeon’s experience and judgment remain among the most significant variables determining survival outcomes and complications.</li><li>Highly subjective endoscopic evaluations are the cornerstone of entire medical fields (e.g., laryngoscopy, GI endoscopy, bronchoscopy).</li><li>Even histopathology, often regarded as the gold standard, can suffer from a high degree of variability in its interpretation.</li></ul><p>These are examples of substantial medical domains that will need to be improved to see practical advancements in the care of patients.<br>However, the first step will challenge the usual paradigm of separating scientific fields into semi-insulated compartments. The successful integration of molecular biology within the medical field is a precedent, suggesting a similar potential for a synergistic conjunction of medicine and computer science. This interdisciplinary approach is crucial for catalyzing real-life developments in patient care.</p><p>In summary, we need a new breed of doctors with the skills to understand and employ AI effectively. And this will likely require restructuring our current medical training.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=c070bb633e9f" width="1" height="1" alt=""><hr><p><a href="https://medium.com/data-science/a-surgeons-reflections-on-artificial-intelligence-c070bb633e9f">A Surgeon’s Reflections on Artificial Intelligence</a> was originally published in <a href="https://medium.com/data-science">TDS Archive</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Navigating the EMA Recommendation for Decentralized Clinical Trials]]></title>
            <link>https://medium.com/@albpaderno/navigating-the-ema-recommendation-for-decentralized-clinical-trials-998c63bbd7cf?source=rss-132e4e52c0a------2</link>
            <guid isPermaLink="false">https://medium.com/p/998c63bbd7cf</guid>
            <category><![CDATA[healthcare-innovations]]></category>
            <category><![CDATA[clinical-trials]]></category>
            <category><![CDATA[healthcare-technology]]></category>
            <category><![CDATA[pharmaceutical]]></category>
            <category><![CDATA[science]]></category>
            <dc:creator><![CDATA[Alberto Paderno]]></dc:creator>
            <pubDate>Mon, 16 Jan 2023 16:15:51 GMT</pubDate>
            <atom:updated>2023-01-16T16:15:51.371Z</atom:updated>
            <content:encoded><![CDATA[<h4>Leveraging Digital Solutions for Improved Mobile Nursing and Patient Outcomes</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*7U_S8bR6WGagZAh4EObafA.png" /></figure><h4>Why is the EMA’s guidance important?</h4><p>The current EMA Recommendation paper on decentralised elements in EU clinical trials is a game-changer for the future of clinical research. With the COVID-19 pandemic highlighting the benefits of decentralised procedures in healthcare and clinical trials, the EMA issued guidance to manage clinical trials during the pandemic. However, the new recommendation paper goes beyond a pandemic scenario, providing guidance on the use of decentralised elements in clinical trials, regardless of any health crisis. <br>The overall aim of the EMA Recommendation paper on decentralised elements in EU clinical trials is to support the development of innovative solutions that not only improve patient outcomes but also ensure the necessary level of trial participant safety, protection of their rights and dignity, and the reliability of data for publication and submission for regulatory decision-making. In particular, these guidelines cover the roles and responsibilities of the sponsor and investigator, electronic informed consent, IMP delivery, trial-related procedures at home, data management, and monitoring in a DCT setting.</p><p>Having a clear and comprehensive regulatory framework for DCTs is crucial to facilitate the development and conduct of these practices. By providing explicit guidelines for executing DCTs, it will be possible to decrease the degree of uncertainty in this area, streamlining the process of developing DCT solutions and ultimately reducing the time and resources required to bring new treatments to market. Additionally, it will ensure that the rights and welfare of the trial participants are protected at all times, and that the data generated is of high quality and suitable for regulatory decision-making.</p><h4>What is the role of home nursing?</h4><p>One of the most significant aspects of DCTs is the use of home nursing and the delivery of trial-related procedures outside the traditional clinical trial site. <br>A recent article shared by the Center for Information and Study on Clinical Research Participation (CISCRP) has shown that travel is ranked the top burden for patients participating in clinical trials (31% of respondents), followed by the length of the study visits and undergoing diagnostic tests (21% of respondents). The study highlights that patients who were offered the option of study visits at their home or office were more likely to report receiving better care and attention compared to those who did not have access to such convenience-enhancing solutions. Notably, the study found that younger patients were more likely to utilise such options in clinical trials, such as visits at home or at the office. This suggests that offering more flexible and convenient options for clinical trial participation can improve patient engagement and satisfaction, particularly among younger patient populations.</p><p>The EMA guidance acknowledges the potential benefits of home nursing for clinical trials but also highlights the need to ensure the quality and safety of these services. This includes ensuring that home nursing staff have the necessary training and competencies and that appropriate systems are in place to monitor each step of the process and support patients remotely.</p><h4>Addressing regulatory requirements with innovative solutions</h4><p>In this context, digital solutions can help in training and oversight in home nursing for clinical trials by providing a system for training and onboarding new staff remotely, as well as ongoing professional development. <br>Specifically, a dedicated platform for tracking and documenting training and competencies can ensure home nursing staff are qualified and competent to perform their duties. In addition, features that allow tracking and recording of each step during trial delivery in home-based operations can improve the overall quality and safety.</p><p>With the increasing trend towards decentralisation in clinical trials, it will be important for home nursing providers to leverage these solutions to ensure that they are providing high-quality care to patients participating in clinical research, while maintaining oversight and compliance to regulations. This will not only improve the overall patient experience, but also ensure that the data generated is of the highest quality, suitable for regulatory decision-making, and ultimately help bring new treatments to market faster.</p><blockquote><em>Links: </em><a href="https://health.ec.europa.eu/system/files/2022-12/mp_decentralised-elements_clinical-trials_rec_en.pdf"><em>https://health.ec.europa.eu/system/files/2022-12/mp_decentralised-elements_clinical-trials_rec_en.pdf</em></a><em> <br>https://www.ciscrp.org/wp-content/uploads/2021/06/Sine2021_Article_PatientEngagementInitiativesIn-FINAL-Article.pdf</em></blockquote><p><strong>Find out more at www.careforme.io</strong></p><p><a href="https://careforme.io/ema_guide_dct_homenursing">Mobile research nursing</a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=998c63bbd7cf" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>