LLM Research GroupAkdeniz Üniversitesi

Department of Computer Engineering · Akdeniz Üniversitesi

LLM Research
Group

A research group at Akdeniz Üniversitesi working on large language models.

Attention(Q, K, V) = softmax(QKᵀ / √dk) V

decoder-only · greedy decoding00/12 tokens

Prompt

Summarise in one sentence: self-attention lets every position in a sequence look at every earlier position.

Completion

Next-token distribution

  • Each0.61
  • Every0.22
  • Tokens0.08

Scripted illustration of next-token prediction — not a live model.

Publications
03
Group members
07
Doctoral students
05
Alumni
00

§ 01 — Research

Work currently underway

The group is new. Our research is best described by the doctoral theses in progress.

next tokensoftmaxAdd & NormFeed-Forwardd_ff = 4·d_modelAdd & NormMulti-Head Self-Attentionh = 8 headsresidual× N+ positional encodingtoken embedding▁self-attention▁lets▁everyinput tokens

The decoder block our work sits inside — activations flow up the residual stream, N layers deep.