roofline.devPublic Beta

GELU Activation

0VERY EASYRankedReport issue

Given vector $\underline{x}$ of length $n$ , produce vector $\underline{y}$ of length $n$ such that, with $i$ indexing over $n$ ,

y_i = \frac{x_i}{2} \left( 1 + \tanh\left( \sqrt{\tfrac{2}{\pi}} \left( x_i + 0.044715 \cdot x_i^3 \right) \right) \right)

Do not use the exact erf-based GELU. Use the approximate form above.

Input

n - the number of elements in the vectors.
x - input vector of length $n$ containing floats $-20 \leq x_i \leq 20$ .

Output

y - output vector of length n where each element is the approximate GELU activation applied to the corresponding element of x.

Open on a desktop browser to write and submit code.