Disabling internal mTLS for HTTP does not work

[pavolloffay]

 35     featureGates:
 36       openshift:
 37         openshiftRoute: false
 38         servingCertsService: false
 39       prometheusOperator: false
 40       httpEncryption: false
 41       grpcEncryption: true
 42       tlsProfile: Modern
 43       builtInCertManagement:
 44         enabled: true

The Jaeger CR from the root readme

The pods end up in this state

 k get pods -w                                                                                                                                    1 ↵ ploffay@fedora
NAME                                            READY   STATUS    RESTARTS   AGE
tempo-simplest-compactor-5bbddd6d45-xmnsq       0/1     Running   0          43s
tempo-simplest-distributor-5b9c89f9d5-dtsfw     0/1     Running   0          43s
tempo-simplest-ingester-0                       0/1     Running   0          43s
tempo-simplest-querier-b4f75c8fd-4mrbb          0/1     Running   0          43s
tempo-simplest-query-frontend-5c8579967-4fbtw   1/2     Running   0          43s

[pavolloffay]

 k logs tempo-simplest-querier-b4f75c8fd-4mrbb                                                                                                    1 ↵ ploffay@fedora
level=info ts=2023-08-15T13:06:05.543506698Z caller=main.go:221 msg="initialising OpenTracing tracer"
level=info ts=2023-08-15T13:06:05.544245887Z caller=main.go:108 msg="Starting Tempo" version="(version=2.2.0, branch=HEAD, revision=cce8df1b6)"
level=info ts=2023-08-15T13:06:05.547379409Z caller=server.go:354 http=[::]:3200 grpc=[::]:9095 msg="server listening on addresses"
level=info ts=2023-08-15T13:06:05.547942298Z caller=memberlist_client.go:437 msg="Using memberlist cluster label and node name" cluster_label= node=tempo-simplest-querier-b4f75c8fd-4mrbb-9fd37ada
level=info ts=2023-08-15T13:06:05.54808902Z caller=tempodb.go:428 msg="polling enabled" interval=5m0s concurrency=50
level=info ts=2023-08-15T13:06:05.54864361Z caller=memberlist_client.go:543 msg="memberlist fast-join starting" nodes_found=1 to_join=2
level=info ts=2023-08-15T13:06:05.54890396Z caller=poller.go:130 msg="blocklist poll complete" seconds=0.000795739
level=info ts=2023-08-15T13:06:05.565559294Z caller=memberlist_client.go:563 msg="memberlist fast-join finished" joined_nodes=1 elapsed_time=16.917772ms
level=info ts=2023-08-15T13:06:05.56557585Z caller=memberlist_client.go:576 msg="joining memberlist cluster" join_members=tempo-simplest-gossip-ring
level=info ts=2023-08-15T13:06:05.634630647Z caller=worker.go:103 msg="Starting querier worker connected to query-frontend" frontend=tempo-simplest-query-frontend-discovery:9095
level=info ts=2023-08-15T13:06:05.634870189Z caller=module_service.go:82 msg=initialising module=store
level=info ts=2023-08-15T13:06:05.634869989Z caller=module_service.go:82 msg=initialising module=internal-server
level=info ts=2023-08-15T13:06:05.634908958Z caller=module_service.go:82 msg=initialising module=server
level=info ts=2023-08-15T13:06:05.635035793Z caller=module_service.go:82 msg=initialising module=memberlist-kv
level=info ts=2023-08-15T13:06:05.635117928Z caller=module_service.go:82 msg=initialising module=overrides
level=info ts=2023-08-15T13:06:05.635158243Z caller=module_service.go:82 msg=initialising module=secondary-ring
level=info ts=2023-08-15T13:06:05.635205731Z caller=module_service.go:82 msg=initialising module=metrics-generator-ring
level=info ts=2023-08-15T13:06:05.635209951Z caller=module_service.go:82 msg=initialising module=ring
level=info ts=2023-08-15T13:06:05.635653231Z caller=memberlist_client.go:595 msg="joining memberlist cluster succeeded" reached_nodes=1 elapsed_time=70.076006ms
level=info ts=2023-08-15T13:06:05.635697364Z caller=ring.go:262 msg="ring doesn't exist in KV store yet"
level=info ts=2023-08-15T13:06:05.635760212Z caller=module_service.go:82 msg=initialising module=querier
level=info ts=2023-08-15T13:06:05.635892876Z caller=app.go:196 msg="Tempo started"
level=info ts=2023-08-15T13:06:05.63628401Z caller=worker.go:179 msg="adding connection" addr=10.244.0.30:9095
level=error ts=2023-08-15T13:06:08.689634746Z caller=frontend_processor.go:63 msg="error contacting frontend" address=10.244.0.30:9095 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial tcp 10.244.0.30:9095: connect: no route to host\""
level=error ts=2023-08-15T13:06:08.690525663Z caller=frontend_processor.go:63 msg="error contacting frontend" address=10.244.0.30:9095 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial tcp 10.244.0.30:9095: connect: no route to host\""
level=error ts=2023-08-15T13:06:08.689634754Z caller=frontend_processor.go:63 msg="error contacting frontend" address=10.244.0.30:9095 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial tcp 10.244.0.30:9095: connect: no route to host\""
level=error ts=2023-08-15T13:06:08.689758963Z caller=frontend_processor.go:63 msg="error contacting frontend" address=10.244.0.30:9095 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial tcp 10.244.0.30:9095: connect: no route to host\""

[pavolloffay]

cc) @rubenvp8510

[rubenvp8510]

This is an old one but I think this was already fixed, or at least I cannot reproduce it now with main

featureGates:
  openshift:
    openshiftRoute: false
    servingCertsService: false
  prometheusOperator: false
  grafanaOperator: false
  httpEncryption: false
  grpcEncryption: true
  tlsProfile: Modern
  builtInCertManagement:
    enabled: true

CR

  apiVersion: tempo.grafana.com/v1alpha1
  kind: TempoStack
  metadata:
    name: simplest
  spec:
    storage:
      secret:
        name: minio
        type: s3
    storageSize: 1Gi
    resources:
      total:
        limits:
          memory: 2Gi
          cpu: 2000m
    template:
      queryFrontend:
        jaegerQuery:
          enabled: true

    replicationFactor: 1

Pods

NAME                                             READY   STATUS    RESTARTS   AGE
minio-55d4d97667-q45v7                           1/1     Running   0          24h
tempo-simplest-compactor-6956c95557-dmd5t        1/1     Running   0          86s
tempo-simplest-distributor-64c957b887-tvlrn      1/1     Running   0          86s
tempo-simplest-ingester-0                        1/1     Running   0          86s
tempo-simplest-querier-57d768b866-nvhng          1/1     Running   0          86s
tempo-simplest-query-frontend-5b8dbf978c-m5ddn   2/2     Running   0          86s