How the Algorithm Thinks It Knows You – and Why That Matters

Read on ⮛

How Recommendation Systems Work – A Practical Map

Before we can talk meaningfully about influence, agency, or choice, we need a shared map.

Not a technical one, and not a moral one. A practical one.

Much of the confusion around “the algorithm” comes from the fact that people discuss its effects without first agreeing on its mechanics. This post exists to set that foundation: to explain, in plain language, how recommendation systems work, introduce the key concepts Luminae will return to repeatedly, and outline where this discussion leads next.

What These Systems Are Actually Optimising For

At their core, modern recommendation systems are optimisation engines.

They are designed to answer a single, continuous question:

“What should we show next to maximise engagement?”

Engagement can mean different things depending on the platform – time spent, clicks, likes, shares, or returns – but the underlying logic is consistent. The system is not optimising for truth, wellbeing, or long-term outcomes. It is optimising for measurable interaction.

This distinction matters because it explains much of what follows. When you understand what a system is trying to maximise, many of its behaviours stop feeling mysterious.

Signals: How Behaviour Becomes Data

Everything begins with signals.

Signals are the observable traces of behaviour that platforms can measure. They include obvious actions such as likes or shares, but also subtler ones: how long you pause, what you scroll past quickly, what you search for late at night, and what you return to repeatedly.

Importantly, signals are not statements of intent. They are interpretations of behaviour.

A pause might mean interest, confusion, disagreement, or distraction. The system does not know which. It simply learns that pausing often correlates with continued engagement, and adjusts accordingly.

Over time, thousands of small signals accumulate into patterns.

Models: From Signals to Prediction

Those patterns are processed by models.

A model is not a profile in the human sense. It is a statistical construct that estimates probabilities: if someone with this pattern of signals is shown this type of content, how likely are they to engage?

Models do not understand meaning. They infer likelihood.

This is why feeds can feel uncannily accurate while still missing the point. The system is good at predicting what you will interact with, not why you care about it, or whether it aligns with your values.

Ranking and Selection: What You See and What You Don’t

Once predictions are made, content must be ranked.

At any moment, there are vastly more items available than can be shown. Ranking is the process of ordering those options based on predicted engagement, relevance, and platform-specific priorities.

This is where influence becomes environmental.

You are not just shown content you like. You are shown content that has outperformed alternatives in holding attention. Equally important is what you are not shown: content that might challenge, bore, slow, or redirect you tends to be deprioritised.

Over time, this shapes the informational landscape you move through.

Feedback Loops: How Influence Reinforces Itself

The most important dynamic to understand is the feedback loop.

When ranked content is shown and interacted with, it generates new signals. Those signals refine the model. The refined model improves future ranking. The loop repeats.

This creates reinforcement.

If a certain theme, emotional tone, or identity consistently draws engagement, it becomes increasingly prominent. If it does not, it fades. The system does not need to decide what is good or bad. Reinforcement alone does the work.

This is why influence rarely feels imposed. It feels like continuity.

Personalisation: Precision Without Understanding

Personalisation is often misunderstood as deep understanding.

In reality, it is precision targeting based on limited inputs.

The system does not know you as a whole person. It knows how a specific slice of your behaviour compares statistically to others. From that, it narrows the range of content you are most likely to see.

The risk is not misrepresentation. The risk is narrowing.

When personalisation becomes tight enough, it can quietly reduce exposure to unfamiliar ideas, alternative framings, or slower forms of thinking – not by design, but by optimisation.

Optimisation Pressure: Why Neutral Systems Drift

Recommendation systems are not static. They are under constant pressure to perform.

As platforms compete for attention, optimisation tends to favour:

  • Emotional intensity over neutrality
  • Familiarity over novelty
  • Speed over reflection

This does not require malicious intent. It emerges naturally from competitive optimisation in attention markets.

Understanding this helps explain why feeds often drift toward certain tones or themes, even when no one explicitly designed them to do so.

A Shared Vocabulary Going Forward

These concepts – signals, models, ranking, feedback loops, personalisation, optimisation – form the working vocabulary of Luminae.

They will recur throughout future Insight Library posts, youth programmes, and discussions in Fact and Friction. Not as technical jargon, but as tools for clearer thinking.

When you can name what is happening, you can notice it more easily. When you can notice it, you regain choice.

Routes Forward

With this map in place, the discussion can now move from mechanics to lived experience.

Future posts will explore:

  • How influence shows up as shifting desire rather than persuasion
  • How emotional tone is shaped over time
  • How identity is subtly reinforced through repetition
  • How small amounts of friction can interrupt automatic momentum
  • How algorithms can be used deliberately rather than passively

The aim is not to resist influence reflexively, but to engage with it consciously.

Understanding how these systems work is not the end of the conversation. It is the point at which a more useful one becomes possible.

We use cookies to improve your experience. By clicking ‘Accept’, you agree to our use of cookies. Privacy Policy