Place chicken, eggs, celery, olives, salt, and pepper in a bowl. Blend mayonnaise and lemon juice together; add to chicken mixture and gently toss together. Chill about 1 hour before serving.