Brxm 14.5.0 sudden off

1

Hi all,

We faced issue on 14.5.0 brxm since 1 day before, now we have restarted cms so many times on goolge kubernetes where my cms is running, but still getting Error: Server Error The server encountered a temporary error and could not complete your request. Please try again in 30 seconds.

Any thing happened globally from cms that break down my ruuning app.?

2

you should check CMS server logs…above error seems to be coming from your LB/ingress controller (it looks like you are runinng this on GCP)

3

HI @machak ,
We are not getting any issues on log, I believe, I have below logs what I found during logs analysis. `


C:\Users\kuma.manish\AppData\Local\Google\Cloud SDK>kubectl logs -f hep-bloomreach-cms-57f5584676-56mhn
--2024-09-24 08:35:38--  http://search.maven.org/remotecontent?filepath=com/mysql/mysql-connector-j/8.0.32/mysql-connector-j-8.0.32.jar
Resolving search.maven.org (search.maven.org)... 18.160.143.69, 18.160.143.24, 18.160.143.120, ...
Connecting to search.maven.org (search.maven.org)|18.160.143.69|:80... connected.
HTTP request sent, awaiting response... 301 Moved Permanently
Location: https://search.maven.org/remotecontent?filepath=com/mysql/mysql-connector-j/8.0.32/mysql-connector-j-8.0.32.jar [following]
--2024-09-24 08:35:38--  https://search.maven.org/remotecontent?filepath=com/mysql/mysql-connector-j/8.0.32/mysql-connector-j-8.0.32.jar
Connecting to search.maven.org (search.maven.org)|18.160.143.69|:443... connected.
HTTP request sent, awaiting response... 302 Moved Temporarily
Location: https://repo1.maven.org/maven2/com/mysql/mysql-connector-j/8.0.32/mysql-connector-j-8.0.32.jar [following]
--2024-09-24 08:35:38--  https://repo1.maven.org/maven2/com/mysql/mysql-connector-j/8.0.32/mysql-connector-j-8.0.32.jar
Resolving repo1.maven.org (repo1.maven.org)... 199.232.192.209, 199.232.196.209, 2a04:4e42:4c::209, ...
Connecting to repo1.maven.org (repo1.maven.org)|199.232.192.209|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2480823 (2.4M) [application/java-archive]
Saving to: ‘/usr/local/tomcat/common/lib/mysql-connector-j-8.0.32.jar’

     0K .......... .......... .......... .......... ..........  2% 3.13M 1s
    50K .......... .......... .......... .......... ..........  4% 4.94M 1s
   100K .......... .......... .......... .......... ..........  6% 23.1M 0s
   150K .......... .......... .......... .......... ..........  8% 6.34M 0s
   200K .......... .......... .......... .......... .......... 10% 22.5M 0s
   250K .......... .......... .......... .......... .......... 12% 27.2M 0s
   300K .......... .......... .......... .......... .......... 14% 42.9M 0s
   350K .......... .......... .......... .......... .......... 16% 8.05M 0s
   400K .......... .......... .......... .......... .......... 18% 65.9M 0s
   450K .......... .......... .......... .......... .......... 20% 30.9M 0s
   500K .......... .......... .......... .......... .......... 22% 98.8M 0s
   550K .......... .......... .......... .......... .......... 24% 87.8M 0s
   600K .......... .......... .......... .......... .......... 26% 51.1M 0s
   650K .......... .......... .......... .......... .......... 28% 38.7M 0s
   700K .......... .......... .......... .......... .......... 30% 11.0M 0s
   750K .......... .......... .......... .......... .......... 33%  104M 0s
   800K .......... .......... .......... .......... .......... 35% 39.9M 0s
   850K .......... .......... .......... .......... .......... 37%  107M 0s
   900K .......... .......... .......... .......... .......... 39% 62.1M 0s
   950K .......... .......... .......... .......... .......... 41% 70.4M 0s
  1000K .......... .......... .......... .......... .......... 43% 83.5M 0s
  1050K .......... .......... .......... .......... .......... 45% 85.7M 0s
  1100K .......... .......... .......... .......... .......... 47% 90.0M 0s
  1150K .......... .......... .......... .......... .......... 49% 89.6M 0s
  1200K .......... .......... .......... .......... .......... 51%  104M 0s
  1250K .......... .......... .......... .......... .......... 53% 75.8M 0s
  1300K .......... .......... .......... .......... .......... 55% 94.7M 0s
  1350K .......... .......... .......... .......... .......... 57% 96.0M 0s
  1400K .......... .......... .......... .......... .......... 59% 95.6M 0s
  1450K .......... .......... .......... .......... .......... 61% 92.2M 0s
  1500K .......... .......... .......... .......... .......... 63% 17.2M 0s
  1550K .......... .......... .......... .......... .......... 66% 98.8M 0s
  1600K .......... .......... .......... .......... .......... 68% 58.3M 0s
  1650K .......... .......... .......... .......... .......... 70% 59.6M 0s
  1700K .......... .......... .......... .......... .......... 72% 71.3M 0s
  1750K .......... .......... .......... .......... .......... 74% 62.9M 0s
  1800K .......... .......... .......... .......... .......... 76% 86.7M 0s
  1850K .......... .......... .......... .......... .......... 78%  103M 0s
  1900K .......... .......... .......... .......... .......... 80% 75.2M 0s
  1950K .......... .......... .......... .......... .......... 82% 71.6M 0s
  2000K .......... .......... .......... .......... .......... 84%  123M 0s
  2050K .......... .......... .......... .......... .......... 86% 78.4M 0s
  2100K .......... .......... .......... .......... .......... 88% 57.7M 0s
  2150K .......... .......... .......... .......... .......... 90%  124M 0s
  2200K .......... .......... .......... .......... .......... 92%  115M 0s
  2250K .......... .......... .......... .......... .......... 94% 97.1M 0s
  2300K .......... .......... .......... .......... .......... 97%  120M 0s
  2350K .......... .......... .......... .......... .......... 99%  119M 0s
  2400K .......... .......... ..                              100%  136M=0.08s

2024-09-24 08:35:38 (30.1 MB/s) - ‘/usr/local/tomcat/common/lib/mysql-connector-j-8.0.32.jar’ saved [2480823/2480823]
.......
......
24.09.2024 08:36:14 DEBUG main [ConnectionHelper.reallyExec:431] SQL-Execution [select 1 from REPOSITORY_FSENTRY where FSENTRY_PATH = ? and FSENTRY_NAME = ?] took [1] ms.
24.09.2024 08:36:14 DEBUG main [ConnectionHelper.reallyExec:431] SQL-Execution [select 1 from REPOSITORY_FSENTRY where FSENTRY_PATH = ? and FSENTRY_NAME = ?] took [0] ms.
24.09.2024 08:36:14 DEBUG main [ConnectionHelper.reallyExec:431] SQL-Execution [select 1 from REPOSITORY_FSENTRY where FSENTRY_PATH = ? and FSENTRY_NAME = ?] took [1] ms.
24.09.2024 08:36:14 DEBUG main [ConnectionHelper.reallyExec:431] SQL-Execution [select REVISION_ID from REPOSITORY_LOCAL_REVISIONS where JOURNAL_ID = ?] took [1] ms.
24.09.2024 08:36:14 DEBUG Camel (myCamelContext) thread #1 - file://inbox [GenericFileConsumer.poll:139] Took 0.001 seconds to poll: inbox
24.09.2024 08:36:15 DEBUG Camel (myCamelContext) thread #1 - file://inbox [GenericFileConsumer.poll:139] Took 0.000 seconds to poll: inbox
24.09.2024 08:36:15 DEBUG Camel (myCamelContext) thread #1 - file://inbox [GenericFileConsumer.poll:139] Took 0.000 seconds to poll: inbox
24.09.2024 08:36:16 DEBUG Camel (myCamelContext) thread #1 - file://inbox [GenericFileConsumer.poll:139] Took 0.000 seconds to poll: inbox
24.09.2024 08:36:16 DEBUG Camel (myCamelContext) thread #1 - file://inbox [GenericFileConsumer.poll:139] Took 0.000 seconds to poll: inbox
24.09.2024 08:36:17 DEBUG Camel (myCamelContext) thread #1 - file://inbox [GenericFileConsumer.poll:139] Took 0.001 seconds to poll: inbox
24.09.2024 08:36:17 DEBUG Camel (myCamelContext) thread #1 - file://inbox [GenericFileConsumer.poll:139] Took 0.000 seconds to poll: inbox
24.09.2024 08:36:18 DEBUG Camel (myCamelContext) thread #1 - file://inbox [GenericFileConsumer.poll:139] Took 0.000 seconds to poll: inbox
24.09.2024 08:36:18 DEBUG Camel (myCamelContext) thread #1 - file://inbox [GenericFileConsumer.poll:139] Took 0.000 seconds to poll: inbox


`
We have integradted brxm with apache camel. I am not getting any issue in logs.
4

did you setup liveness/readiness/health checks properly? If not, ingress will not setup properly, ingress will not forward any requests you your application…

5

Yes, we have configured readiness, we are facing this issue on prod that is/was the running environment and since yesterday it’s down,

Below is my readiness.

readinessProbe:
failureThreshold: 20
httpGet:
path: /site/ping/
port: 8080
scheme: HTTP
initialDelaySeconds: 45
periodSeconds: 10
successThreshold: 1
timeoutSeconds: 1